[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:51:51 dist-test-slave-0b58 krb5kdc[11069](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:51:51 dist-test-slave-0b58 krb5kdc[11069](info): set up 2 sockets
Aug 09 06:51:51 dist-test-slave-0b58 krb5kdc[11069](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 06:51:52.350422 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.002s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:51:52 dist-test-slave-0b58 krb5kdc[11069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:51:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:51:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:51:52.555909 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:46077
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:34971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:46077
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:51:52.903082 11082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:51:52.903450 11082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:51:52.903637 11082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:51:52.911628 11082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:51:52.911825 11082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:51:52.911945 11082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:51:52.912052 11082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:51:52.912148 11082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:51:52.922753 11082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:46077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:46077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:51:52.924676 11082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:51:52.926224 11082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:51:52.940553 11089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:52.940817 11088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:52.941349 11091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:51:52.942456 11082 server_base.cc:1034] running on GCE node
I20260809 06:51:52.943444 11082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:51:52.945063 11082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:51:52.946267 11082 hybrid_clock.cc:648] HybridClock initialized: now 1786258312946225 us; error 29 us; skew 500 ppm
I20260809 06:51:52.946799 11082 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:51:52 dist-test-slave-0b58 krb5kdc[11069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258312, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:51:52.950187 11082 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:51:52.951771 11082 webserver.cc:460] Webserver started at http://127.10.205.126:36917/ using document root <none> and password file <none>
I20260809 06:51:52.952580 11082 fs_manager.cc:359] Metadata directory not provided
I20260809 06:51:52.952728 11082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:51:52.953047 11082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:51:52.956455 11082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "67522f16e6b645268da16b5cdd0153c4"
format_stamp: "Formatted at 2026-08-09 06:51:52 on dist-test-slave-0b58"
server_key: "0843f49a01e3494ee5f3386e48b7f9d1"
server_key_iv: "560c7a9449b691c8f045df4f0ee041b5"
server_key_version: "encryptionkey@0"
I20260809 06:51:52.957646 11082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "67522f16e6b645268da16b5cdd0153c4"
format_stamp: "Formatted at 2026-08-09 06:51:52 on dist-test-slave-0b58"
server_key: "0843f49a01e3494ee5f3386e48b7f9d1"
server_key_iv: "560c7a9449b691c8f045df4f0ee041b5"
server_key_version: "encryptionkey@0"
I20260809 06:51:52.963249 11082 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:51:52.966789 11098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:52.968101 11082 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:51:52.968334 11082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "67522f16e6b645268da16b5cdd0153c4"
format_stamp: "Formatted at 2026-08-09 06:51:52 on dist-test-slave-0b58"
server_key: "0843f49a01e3494ee5f3386e48b7f9d1"
server_key_iv: "560c7a9449b691c8f045df4f0ee041b5"
server_key_version: "encryptionkey@0"
I20260809 06:51:52.968600 11082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:51:52.986424 11082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:51:52.990764 11082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:51:52.991076 11082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:51:53.011474 11082 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:46077
I20260809 06:51:53.011504 11150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:46077 every 8 connection(s)
I20260809 06:51:53.012925 11082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:51:53.015990 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 11082
I20260809 06:51:53.016373 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:51:53.017438 11151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:51:53.018940 11061 external_mini_cluster.cc:1428] Setting key 2269deb02bc96364cfd91244629dd3fb
I20260809 06:51:53.030670 11151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4: Bootstrap starting.
I20260809 06:51:53.033870 11151 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4: Neither blocks nor log segments found. Creating new log.
I20260809 06:51:53.035022 11151 log.cc:824] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4: Log is configured to *not* fsync() on all Append() calls
I20260809 06:51:53.038653 11151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4: No bootstrap required, opened a new log
I20260809 06:51:53.049099 11151 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67522f16e6b645268da16b5cdd0153c4" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 46077 } }
I20260809 06:51:53.049716 11151 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:51:53.049836 11151 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67522f16e6b645268da16b5cdd0153c4, State: Initialized, Role: FOLLOWER
I20260809 06:51:53.050571 11151 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67522f16e6b645268da16b5cdd0153c4" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 46077 } }
I20260809 06:51:53.050879 11151 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:51:53.051045 11151 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:51:53.051225 11151 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 06:51:53 dist-test-slave-0b58 krb5kdc[11069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:51:53.054153 11151 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67522f16e6b645268da16b5cdd0153c4" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 46077 } }
I20260809 06:51:53.054714 11151 leader_election.cc:302] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67522f16e6b645268da16b5cdd0153c4; no voters:
I20260809 06:51:53.055464 11151 leader_election.cc:288] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:51:53.055644 11156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:51:53.056391 11156 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [term 1 LEADER]: Becoming Leader. State: Replica: 67522f16e6b645268da16b5cdd0153c4, State: Running, Role: LEADER
I20260809 06:51:53.057955 11156 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67522f16e6b645268da16b5cdd0153c4" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 46077 } }
I20260809 06:51:53.058197 11151 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:51:53.061035 11157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67522f16e6b645268da16b5cdd0153c4. Latest consensus state: current_term: 1 leader_uuid: "67522f16e6b645268da16b5cdd0153c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67522f16e6b645268da16b5cdd0153c4" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 46077 } } }
I20260809 06:51:53.061400 11157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [sys.catalog]: This master's current role is: LEADER
I20260809 06:51:53.061889 11158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67522f16e6b645268da16b5cdd0153c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67522f16e6b645268da16b5cdd0153c4" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 46077 } } }
I20260809 06:51:53.062206 11158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4 [sys.catalog]: This master's current role is: LEADER
I20260809 06:51:53.067428 11153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:53.023752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58920 (local address 127.10.205.126:46077)
0809 06:51:53.026094 (+ 2342us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:53.026111 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:53.026186 (+ 75us) server_negotiation.cc:407] Connection header received
0809 06:51:53.035047 (+ 8861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:53.035067 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:53.035510 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:53.035988 (+ 478us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:53.040018 (+ 4030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:53.041805 (+ 1787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:53.044540 (+ 2735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:53.045283 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:53.045427 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:53.053113 (+ 7686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:53.053125 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:53.053140 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:53.053183 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:53.057321 (+ 4138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:53.058431 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:53.058439 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:53.058446 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:53.058656 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:53.059243 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:53.059248 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:53.059251 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:53.060204 (+ 953us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:53.064140 (+ 3936us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:53.064512 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 06:51:53.065059 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2103,"thread_start_us":1840,"threads_started":1}
I20260809 06:51:53.078665 11161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:51:53.084484 11161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:51:53.093447 11161 catalog_manager.cc:1347] Generated new cluster ID: a19562b0ea154696ac7e2df23b9ca667
I20260809 06:51:53.093571 11161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:51:53.103755 11161 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:51:53.105477 11161 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:51:53.118726 11161 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67522f16e6b645268da16b5cdd0153c4: Generated new TSK 0
I20260809 06:51:53.119812 11161 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:51:53.179652 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:46077
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:34971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:51:53.525058 11180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:51:53.525345 11180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:51:53.525525 11180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:51:53.532914 11180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:51:53.533032 11180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:51:53.533264 11180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:51:53.543679 11180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:46077
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:51:53.545133 11180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:51:53.546559 11180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:51:53.560859 11188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:53.560838 11186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:53.560904 11185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:51:53.562099 11180 server_base.cc:1034] running on GCE node
I20260809 06:51:53.562744 11180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:51:53.563876 11180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:51:53.565109 11180 hybrid_clock.cc:648] HybridClock initialized: now 1786258313565073 us; error 76 us; skew 500 ppm
I20260809 06:51:53.565402 11180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:51:53 dist-test-slave-0b58 krb5kdc[11069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258313, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:51:53.568625 11180 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:51:53.570248 11180 webserver.cc:460] Webserver started at http://127.10.205.65:41185/ using document root <none> and password file <none>
I20260809 06:51:53.570978 11180 fs_manager.cc:359] Metadata directory not provided
I20260809 06:51:53.571087 11180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:51:53.571374 11180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:51:53.574681 11180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "57f16ffa519f4359aed38477621e8d30"
format_stamp: "Formatted at 2026-08-09 06:51:53 on dist-test-slave-0b58"
server_key: "d13570f5fda0e878578ed050e2260ab9"
server_key_iv: "1adc50a3b88031cd2331182f16a12e36"
server_key_version: "encryptionkey@0"
I20260809 06:51:53.575500 11180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "57f16ffa519f4359aed38477621e8d30"
format_stamp: "Formatted at 2026-08-09 06:51:53 on dist-test-slave-0b58"
server_key: "d13570f5fda0e878578ed050e2260ab9"
server_key_iv: "1adc50a3b88031cd2331182f16a12e36"
server_key_version: "encryptionkey@0"
I20260809 06:51:53.581353 11180 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 06:51:53.584911 11195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:53.586349 11180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:51:53.586539 11180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "57f16ffa519f4359aed38477621e8d30"
format_stamp: "Formatted at 2026-08-09 06:51:53 on dist-test-slave-0b58"
server_key: "d13570f5fda0e878578ed050e2260ab9"
server_key_iv: "1adc50a3b88031cd2331182f16a12e36"
server_key_version: "encryptionkey@0"
I20260809 06:51:53.586750 11180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:51:53.614908 11180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:51:53.619854 11180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:51:53.620167 11180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:51:53.621279 11180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:51:53.622747 11180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:51:53.622828 11180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:53.622916 11180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:51:53.622961 11180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:53.661311 11180 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:38489
I20260809 06:51:53.661381 11312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:38489 every 8 connection(s)
I20260809 06:51:53.662711 11180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:51:53.672017 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 11180
I20260809 06:51:53.672303 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:51:53.673020 11061 external_mini_cluster.cc:1428] Setting key fb1f5adfd78ac2527da4fa7ac80c2093
Aug 09 06:51:53 dist-test-slave-0b58 krb5kdc[11069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258313, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:51:53.685526 11315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:53.665474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:56831 (local address 127.10.205.126:46077)
0809 06:51:53.665928 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:53.665933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:53.666927 (+ 994us) server_negotiation.cc:407] Connection header received
0809 06:51:53.668822 (+ 1895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:53.668826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:53.668898 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:53.669001 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:53.670506 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:53.671232 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:53.673075 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:53.673729 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:53.673856 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:53.677701 (+ 3845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:53.677710 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:53.677718 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:53.677784 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:53.682156 (+ 4372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:53.682930 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:53.682938 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:53.682942 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:53.683125 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:53.683565 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:53.683573 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:53.683578 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:53.684062 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:53.684230 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:53.685064 (+ 834us) server_negotiation.cc:299] Negotiation successful
0809 06:51:53.685242 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":223,"threads_started":1}
I20260809 06:51:53.687170 11317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:53.666052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:46077 (local address 127.10.205.65:56831)
0809 06:51:53.666743 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0809 06:51:53.666803 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 06:51:53.668564 (+ 1761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:51:53.669206 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:51:53.669214 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:51:53.669745 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:51:53.670352 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:53.670369 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:53.671409 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:53.671412 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:53.672908 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:53.672921 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:53.673999 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:53.674009 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:53.674265 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:53.675017 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:51:53.675048 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:51:53.677421 (+ 2373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:51:53.682318 (+ 4897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:51:53.682325 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:51:53.682340 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:51:53.682787 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:51:53.683235 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:51:53.683238 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:51:53.683240 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:51:53.683434 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:51:53.684192 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:51:53.684198 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:51:53.684613 (+ 415us) client_negotiation.cc:769] Sending connection context
0809 06:51:53.684953 (+ 340us) client_negotiation.cc:240] Negotiation successful
0809 06:51:53.685598 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":262,"threads_started":1}
I20260809 06:51:53.688872 11313 heartbeater.cc:347] Connected to a master server at 127.10.205.126:46077
I20260809 06:51:53.689205 11313 heartbeater.cc:464] Registering TS with master...
I20260809 06:51:53.690079 11313 heartbeater.cc:511] Master 127.10.205.126:46077 requested a full tablet report, sending...
I20260809 06:51:53.692513 11116 ts_manager.cc:194] Registered new tserver with Master: 57f16ffa519f4359aed38477621e8d30 (127.10.205.65:38489)
I20260809 06:51:53.694094 11116 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:56831
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:51:53.727169 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:46077
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:34971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:51:54.071684 11320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:51:54.071987 11320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:51:54.072182 11320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:51:54.079952 11320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:51:54.080092 11320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:51:54.080349 11320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:51:54.090958 11320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:46077
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:51:54.092568 11320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:51:54.094395 11320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:51:54.108865 11326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:54.108767 11327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:54.108732 11329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:51:54.109791 11320 server_base.cc:1034] running on GCE node
I20260809 06:51:54.110589 11320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:51:54.111584 11320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:51:54.112787 11320 hybrid_clock.cc:648] HybridClock initialized: now 1786258314112739 us; error 35 us; skew 500 ppm
I20260809 06:51:54.113122 11320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:51:54 dist-test-slave-0b58 krb5kdc[11069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258314, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:51:54.116550 11320 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:51:54.118100 11320 webserver.cc:460] Webserver started at http://127.10.205.66:34073/ using document root <none> and password file <none>
I20260809 06:51:54.118922 11320 fs_manager.cc:359] Metadata directory not provided
I20260809 06:51:54.119078 11320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:51:54.119405 11320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:51:54.122570 11320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "a8a4aa7e75394f2a95df6ceb87b50749"
format_stamp: "Formatted at 2026-08-09 06:51:54 on dist-test-slave-0b58"
server_key: "f67301464d1769c82e7c24e525fcaffc"
server_key_iv: "c8d0b1d42dd31581d248233f6d817f02"
server_key_version: "encryptionkey@0"
I20260809 06:51:54.123332 11320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "a8a4aa7e75394f2a95df6ceb87b50749"
format_stamp: "Formatted at 2026-08-09 06:51:54 on dist-test-slave-0b58"
server_key: "f67301464d1769c82e7c24e525fcaffc"
server_key_iv: "c8d0b1d42dd31581d248233f6d817f02"
server_key_version: "encryptionkey@0"
I20260809 06:51:54.129582 11320 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 06:51:54.133275 11336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:54.134739 11320 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:51:54.134951 11320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "a8a4aa7e75394f2a95df6ceb87b50749"
format_stamp: "Formatted at 2026-08-09 06:51:54 on dist-test-slave-0b58"
server_key: "f67301464d1769c82e7c24e525fcaffc"
server_key_iv: "c8d0b1d42dd31581d248233f6d817f02"
server_key_version: "encryptionkey@0"
I20260809 06:51:54.135206 11320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:51:54.155032 11320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:51:54.159544 11320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:51:54.159878 11320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:51:54.160979 11320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:51:54.162405 11320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:51:54.162519 11320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:54.162671 11320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:51:54.162746 11320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:54.199126 11320 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:38099
I20260809 06:51:54.199177 11453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:38099 every 8 connection(s)
I20260809 06:51:54.200640 11320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:51:54.208577 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 11320
I20260809 06:51:54.208808 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:51:54.209368 11061 external_mini_cluster.cc:1428] Setting key dc592b6c673d43e204560ecf0fd685d6
Aug 09 06:51:54 dist-test-slave-0b58 krb5kdc[11069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258314, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:51:54.224587 11456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:54.203410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:51881 (local address 127.10.205.126:46077)
0809 06:51:54.203872 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:54.203876 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:54.204971 (+ 1095us) server_negotiation.cc:407] Connection header received
0809 06:51:54.206752 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:54.206762 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:54.206833 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:54.206934 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:54.208561 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.209711 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.211573 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.212016 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.212145 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:54.215921 (+ 3776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:54.215931 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:54.215938 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:54.216046 (+ 108us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:54.220293 (+ 4247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:54.221110 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:54.221117 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:54.221137 (+ 20us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:54.221263 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:54.221820 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:54.221823 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:54.221825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:54.222098 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:54.222204 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:54.223424 (+ 1220us) server_negotiation.cc:299] Negotiation successful
0809 06:51:54.223811 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":222,"threads_started":1}
I20260809 06:51:54.225425 11458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:54.203979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:46077 (local address 127.10.205.66:51881)
0809 06:51:54.204801 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0809 06:51:54.204848 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:51:54.206495 (+ 1647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:51:54.207150 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:51:54.207158 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:51:54.207705 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:51:54.208377 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:54.208398 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.209873 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.209877 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:54.211426 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:54.211439 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.212281 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.212290 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:54.212520 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:54.213353 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:51:54.213381 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:51:54.215595 (+ 2214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:51:54.220445 (+ 4850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:51:54.220452 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:51:54.220466 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:51:54.220938 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:51:54.221375 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:51:54.221382 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:51:54.221387 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:51:54.221662 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:51:54.222230 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:51:54.222240 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:51:54.222773 (+ 533us) client_negotiation.cc:769] Sending connection context
0809 06:51:54.223156 (+ 383us) client_negotiation.cc:240] Negotiation successful
0809 06:51:54.223817 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":351,"threads_started":1}
I20260809 06:51:54.227684 11454 heartbeater.cc:347] Connected to a master server at 127.10.205.126:46077
I20260809 06:51:54.228051 11454 heartbeater.cc:464] Registering TS with master...
I20260809 06:51:54.229082 11454 heartbeater.cc:511] Master 127.10.205.126:46077 requested a full tablet report, sending...
I20260809 06:51:54.230973 11116 ts_manager.cc:194] Registered new tserver with Master: a8a4aa7e75394f2a95df6ceb87b50749 (127.10.205.66:38099)
I20260809 06:51:54.231848 11116 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:51881
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:51:54.267375 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:46077
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:34971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:51:54.614336 11461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:51:54.614646 11461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:51:54.614748 11461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:51:54.622196 11461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:51:54.622319 11461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:51:54.622439 11461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:51:54.632756 11461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:46077
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:51:54.634125 11461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:51:54.635434 11461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:51:54.649143 11466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:54.649758 11467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:51:54.653088 11461 server_base.cc:1034] running on GCE node
W20260809 06:51:54.653474 11469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:51:54.654258 11461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:51:54.655283 11461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:51:54.656486 11461 hybrid_clock.cc:648] HybridClock initialized: now 1786258314656415 us; error 58 us; skew 500 ppm
I20260809 06:51:54.656828 11461 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:51:54 dist-test-slave-0b58 krb5kdc[11069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258314, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:51:54.660336 11461 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:51:54.662138 11461 webserver.cc:460] Webserver started at http://127.10.205.67:40033/ using document root <none> and password file <none>
I20260809 06:51:54.662890 11461 fs_manager.cc:359] Metadata directory not provided
I20260809 06:51:54.663046 11461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:51:54.663376 11461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:51:54.666517 11461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "412493b6c50c482ebb820b7b6454dc08"
format_stamp: "Formatted at 2026-08-09 06:51:54 on dist-test-slave-0b58"
server_key: "fa11b05562940a78fbbfe7ad81f3cddc"
server_key_iv: "086b852dfbc086dd41e7d493fba91ba7"
server_key_version: "encryptionkey@0"
I20260809 06:51:54.667344 11461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "412493b6c50c482ebb820b7b6454dc08"
format_stamp: "Formatted at 2026-08-09 06:51:54 on dist-test-slave-0b58"
server_key: "fa11b05562940a78fbbfe7ad81f3cddc"
server_key_iv: "086b852dfbc086dd41e7d493fba91ba7"
server_key_version: "encryptionkey@0"
I20260809 06:51:54.673069 11461 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260809 06:51:54.676658 11477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:54.678056 11461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 06:51:54.678241 11461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "412493b6c50c482ebb820b7b6454dc08"
format_stamp: "Formatted at 2026-08-09 06:51:54 on dist-test-slave-0b58"
server_key: "fa11b05562940a78fbbfe7ad81f3cddc"
server_key_iv: "086b852dfbc086dd41e7d493fba91ba7"
server_key_version: "encryptionkey@0"
I20260809 06:51:54.678454 11461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:51:54.692801 11461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:51:54.696938 11461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:51:54.697204 11313 heartbeater.cc:503] Master 127.10.205.126:46077 was elected leader, sending a full tablet report...
I20260809 06:51:54.697247 11461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:51:54.698410 11461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:51:54.700028 11461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:51:54.700109 11461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:54.700194 11461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:51:54.700243 11461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:54.737064 11461 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:42123
I20260809 06:51:54.737100 11595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:42123 every 8 connection(s)
I20260809 06:51:54.738440 11461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:51:54.740767 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 11461
I20260809 06:51:54.741035 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:51:54.741659 11061 external_mini_cluster.cc:1428] Setting key d03b9a7f48be2052d195cd87abd9e7f6
Aug 09 06:51:54 dist-test-slave-0b58 krb5kdc[11069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258314, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:51:54.761088 11598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:54.741413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:49905 (local address 127.10.205.126:46077)
0809 06:51:54.741887 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:54.741891 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:54.743549 (+ 1658us) server_negotiation.cc:407] Connection header received
0809 06:51:54.746191 (+ 2642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:54.746196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:54.746292 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:54.746416 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:54.747942 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.748863 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.750547 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.750956 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.751109 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:54.754685 (+ 3576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:54.754691 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:54.754694 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:54.754728 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:54.757591 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:54.758479 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:54.758491 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:54.758494 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:54.758614 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:54.759079 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:54.759085 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:54.759088 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:54.759487 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:54.759657 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:54.760476 (+ 819us) server_negotiation.cc:299] Negotiation successful
0809 06:51:54.760697 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":252,"threads_started":1}
I20260809 06:51:54.762073 11600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:54.742104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:46077 (local address 127.10.205.67:49905)
0809 06:51:54.743333 (+ 1229us) negotiation.cc:107] Waiting for socket to connect
0809 06:51:54.743383 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 06:51:54.745870 (+ 2487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:51:54.746667 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:51:54.746675 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:51:54.747196 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:51:54.747772 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:54.747799 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.749019 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.749029 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:54.750400 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:54.750413 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.751200 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.751207 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:54.751437 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:54.752074 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:51:54.752096 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:51:54.754461 (+ 2365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:51:54.757748 (+ 3287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:51:54.757757 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:51:54.757782 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:51:54.758356 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:51:54.758738 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:51:54.758744 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:51:54.758747 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:51:54.758962 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:51:54.759617 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:51:54.759625 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:51:54.759997 (+ 372us) client_negotiation.cc:769] Sending connection context
0809 06:51:54.760359 (+ 362us) client_negotiation.cc:240] Negotiation successful
0809 06:51:54.760922 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":938,"thread_start_us":668,"threads_started":1}
I20260809 06:51:54.763453 11596 heartbeater.cc:347] Connected to a master server at 127.10.205.126:46077
I20260809 06:51:54.763797 11596 heartbeater.cc:464] Registering TS with master...
I20260809 06:51:54.764593 11596 heartbeater.cc:511] Master 127.10.205.126:46077 requested a full tablet report, sending...
I20260809 06:51:54.765969 11116 ts_manager.cc:194] Registered new tserver with Master: 412493b6c50c482ebb820b7b6454dc08 (127.10.205.67:42123)
I20260809 06:51:54.766798 11116 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:49905
I20260809 06:51:54.770819 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 06:51:54 dist-test-slave-0b58 krb5kdc[11069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258314, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 06:51:54 dist-test-slave-0b58 krb5kdc[11069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258314, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:51:54.826906 11605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:54.811549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47130 (local address 127.10.205.65:38489)
0809 06:51:54.812248 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:54.812334 (+ 86us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:54.812382 (+ 48us) server_negotiation.cc:407] Connection header received
0809 06:51:54.812451 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:54.812458 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:54.812694 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:54.812838 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:54.814544 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.815574 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.816884 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.817474 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.817574 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:54.821584 (+ 4010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:54.821596 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:54.821611 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:54.821653 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:54.824462 (+ 2809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:54.825100 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:54.825107 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:54.825109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:54.825236 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:54.825571 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:54.825574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:54.825576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:54.825916 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:54.826157 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:54.826410 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 06:51:54.826614 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":362,"threads_started":1}
W20260809 06:51:54.828215 11224 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47130
Aug 09 06:51:54 dist-test-slave-0b58 krb5kdc[11069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 06:51:54 dist-test-slave-0b58 krb5kdc[11069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:51:54.881844 11605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:54.868189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47144 (local address 127.10.205.65:38489)
0809 06:51:54.868471 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:54.868490 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:54.868613 (+ 123us) server_negotiation.cc:407] Connection header received
0809 06:51:54.868760 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:54.868764 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:54.868871 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:54.868959 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:54.870288 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.870978 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.872133 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.872654 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.872777 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:54.876907 (+ 4130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:54.876912 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:54.876916 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:54.876950 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:54.879479 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:54.880093 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:54.880097 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:54.880099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:54.880217 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:54.880619 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:54.880622 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:54.880624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:54.880883 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:54.881061 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:54.881324 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 06:51:54.881492 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260809 06:51:54.883585 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 11180
I20260809 06:51:54.896409 11605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:54.884596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47152 (local address 127.10.205.65:38489)
0809 06:51:54.884835 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:54.884841 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:54.885076 (+ 235us) server_negotiation.cc:407] Connection header received
0809 06:51:54.885189 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:54.885193 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:54.885247 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:54.885320 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:54.886442 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.887127 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.888405 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:54.888817 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:54.888908 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:54.891309 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:54.891314 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:54.891317 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:54.891345 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:54.894155 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:54.894732 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:54.894735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:54.894738 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:54.894876 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:54.895175 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:54.895178 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:54.895179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:54.895426 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:54.895603 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:54.895843 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 06:51:54.895999 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:51:54.897193 11308 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:51:54.984208 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 11180
I20260809 06:51:55.003716 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 11320
Aug 09 06:51:55 dist-test-slave-0b58 krb5kdc[11069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:51:55.021349 11612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:55.004680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38122 (local address 127.10.205.66:38099)
0809 06:51:55.005264 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:55.005271 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:55.005298 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:51:55.005363 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:55.005369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:55.005576 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:55.005709 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:55.006914 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:55.007933 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:55.009327 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:55.009879 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:55.009979 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:55.015230 (+ 5251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:55.015242 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:55.015257 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:55.015302 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:55.018336 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:55.019043 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:55.019051 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:55.019053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:55.019189 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:55.019635 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:55.019639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:55.019641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:55.020000 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:55.020337 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:55.020688 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 06:51:55.020996 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":304,"threads_started":1}
I20260809 06:51:55.022861 11449 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:51:55.107379 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 11320
I20260809 06:51:55.129109 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 11461
Aug 09 06:51:55 dist-test-slave-0b58 krb5kdc[11069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:51:55.151412 11614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:55.130307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47578 (local address 127.10.205.67:42123)
0809 06:51:55.130895 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:55.130902 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:55.130930 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:51:55.130993 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:55.131000 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:55.131210 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:55.131395 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:55.132825 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:55.133890 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:55.135193 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:55.135770 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:55.135930 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:55.145078 (+ 9148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:55.145095 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:55.145112 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:55.145154 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:55.147967 (+ 2813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:55.148846 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:55.148855 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:55.148857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:55.148991 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:55.149432 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:55.149436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:55.149438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:55.149832 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:55.150218 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:55.150700 (+ 482us) server_negotiation.cc:299] Negotiation successful
0809 06:51:55.151020 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":274,"threads_started":1}
I20260809 06:51:55.152819 11591 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:51:55.236565 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 11461
I20260809 06:51:55.255749 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 11082
I20260809 06:51:55.257166 11146 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:51:55.362788 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 11082
2026-08-09T06:51:55Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4165 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:51:55 dist-test-slave-0b58 krb5kdc[11620](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:51:55 dist-test-slave-0b58 krb5kdc[11620](info): set up 2 sockets
Aug 09 06:51:55 dist-test-slave-0b58 krb5kdc[11620](info): commencing operation
krb5kdc: starting...
W20260809 06:51:56.487438 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.002s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:51:56 dist-test-slave-0b58 krb5kdc[11620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:51:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:51:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:51:56.696128 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:41463
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:35499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:41463
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:51:57.029371 11634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:51:57.029657 11634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:51:57.029846 11634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:51:57.037237 11634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:51:57.037370 11634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:51:57.037418 11634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:51:57.037499 11634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:51:57.037566 11634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:51:57.047600 11634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:35499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:41463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:41463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:51:57.048992 11634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:51:57.050324 11634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:51:57.062230 11639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:57.062222 11642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:57.062273 11640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:51:57.063411 11634 server_base.cc:1034] running on GCE node
I20260809 06:51:57.064159 11634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:51:57.065626 11634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:51:57.066872 11634 hybrid_clock.cc:648] HybridClock initialized: now 1786258317066795 us; error 64 us; skew 500 ppm
I20260809 06:51:57.067219 11634 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:51:57 dist-test-slave-0b58 krb5kdc[11620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258317, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:51:57.070287 11634 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:51:57.071825 11634 webserver.cc:460] Webserver started at http://127.10.205.126:35127/ using document root <none> and password file <none>
I20260809 06:51:57.072575 11634 fs_manager.cc:359] Metadata directory not provided
I20260809 06:51:57.072721 11634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:51:57.073031 11634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:51:57.075932 11634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "7273b7b966634f1399ec88e84c789fd5"
format_stamp: "Formatted at 2026-08-09 06:51:57 on dist-test-slave-0b58"
server_key: "7f1626268219d2213c42b7822e88782d"
server_key_iv: "6775c01afbfba825280214408139c064"
server_key_version: "encryptionkey@0"
I20260809 06:51:57.076874 11634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "7273b7b966634f1399ec88e84c789fd5"
format_stamp: "Formatted at 2026-08-09 06:51:57 on dist-test-slave-0b58"
server_key: "7f1626268219d2213c42b7822e88782d"
server_key_iv: "6775c01afbfba825280214408139c064"
server_key_version: "encryptionkey@0"
I20260809 06:51:57.082126 11634 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:51:57.085613 11650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:57.086982 11634 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:51:57.087162 11634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "7273b7b966634f1399ec88e84c789fd5"
format_stamp: "Formatted at 2026-08-09 06:51:57 on dist-test-slave-0b58"
server_key: "7f1626268219d2213c42b7822e88782d"
server_key_iv: "6775c01afbfba825280214408139c064"
server_key_version: "encryptionkey@0"
I20260809 06:51:57.087383 11634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:51:57.109114 11634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:51:57.113365 11634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:51:57.113682 11634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:51:57.132897 11705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:41463 every 8 connection(s)
I20260809 06:51:57.132998 11634 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:41463
I20260809 06:51:57.134601 11634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:51:57.137562 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 11634
I20260809 06:51:57.137815 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:51:57.138535 11061 external_mini_cluster.cc:1428] Setting key 553c0c0ca833f80b16689da804a25207
I20260809 06:51:57.138680 11706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:51:57.153348 11706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5: Bootstrap starting.
Aug 09 06:51:57 dist-test-slave-0b58 krb5kdc[11620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:51:57.157157 11706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5: Neither blocks nor log segments found. Creating new log.
I20260809 06:51:57.158596 11706 log.cc:824] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5: Log is configured to *not* fsync() on all Append() calls
I20260809 06:51:57.162334 11706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5: No bootstrap required, opened a new log
I20260809 06:51:57.164129 11709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:57.140587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51512 (local address 127.10.205.126:41463)
0809 06:51:57.141357 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:57.141376 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:57.141428 (+ 52us) server_negotiation.cc:407] Connection header received
0809 06:51:57.143688 (+ 2260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:57.143724 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:57.144230 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:57.144684 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:57.146067 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:57.148075 (+ 2008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:57.149342 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:57.150645 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:57.150869 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:57.155181 (+ 4312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:57.155192 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:57.155213 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:57.155266 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:57.159361 (+ 4095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:57.160306 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:57.160316 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:57.160325 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:57.160530 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:57.160896 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:57.160900 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:57.160903 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:57.161608 (+ 705us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:57.161908 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:57.162312 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 06:51:57.162785 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":311,"threads_started":1}
I20260809 06:51:57.171046 11706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7273b7b966634f1399ec88e84c789fd5" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41463 } }
I20260809 06:51:57.171449 11706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:51:57.171525 11706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7273b7b966634f1399ec88e84c789fd5, State: Initialized, Role: FOLLOWER
I20260809 06:51:57.172011 11706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7273b7b966634f1399ec88e84c789fd5" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41463 } }
I20260809 06:51:57.172226 11706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:51:57.172398 11706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:51:57.172609 11706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:51:57.175108 11706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7273b7b966634f1399ec88e84c789fd5" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41463 } }
I20260809 06:51:57.175604 11706 leader_election.cc:302] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7273b7b966634f1399ec88e84c789fd5; no voters:
I20260809 06:51:57.176203 11706 leader_election.cc:288] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:51:57.176388 11711 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:51:57.178038 11711 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [term 1 LEADER]: Becoming Leader. State: Replica: 7273b7b966634f1399ec88e84c789fd5, State: Running, Role: LEADER
I20260809 06:51:57.178669 11706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:51:57.178604 11711 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7273b7b966634f1399ec88e84c789fd5" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41463 } }
I20260809 06:51:57.181380 11713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7273b7b966634f1399ec88e84c789fd5. Latest consensus state: current_term: 1 leader_uuid: "7273b7b966634f1399ec88e84c789fd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7273b7b966634f1399ec88e84c789fd5" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41463 } } }
I20260809 06:51:57.181779 11713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [sys.catalog]: This master's current role is: LEADER
I20260809 06:51:57.182379 11712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7273b7b966634f1399ec88e84c789fd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7273b7b966634f1399ec88e84c789fd5" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41463 } } }
I20260809 06:51:57.182731 11712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5 [sys.catalog]: This master's current role is: LEADER
I20260809 06:51:57.182948 11718 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:51:57.191681 11718 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:51:57.201931 11718 catalog_manager.cc:1347] Generated new cluster ID: fa712578b7ae49d3b4f72189092ff784
I20260809 06:51:57.202064 11718 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:51:57.214314 11718 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:51:57.216312 11718 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:51:57.225699 11718 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7273b7b966634f1399ec88e84c789fd5: Generated new TSK 0
I20260809 06:51:57.226817 11718 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:51:57.280900 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:41463
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:35499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:51:57.639806 11734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:51:57.640118 11734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:51:57.640221 11734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:51:57.647689 11734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:51:57.647857 11734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:51:57.648097 11734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:51:57.659355 11734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:35499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:41463
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:51:57.660846 11734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:51:57.662225 11734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:51:57.675608 11742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:57.675642 11740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:57.675868 11739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:51:57.676563 11734 server_base.cc:1034] running on GCE node
I20260809 06:51:57.677251 11734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:51:57.678218 11734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:51:57.679471 11734 hybrid_clock.cc:648] HybridClock initialized: now 1786258317679424 us; error 32 us; skew 500 ppm
I20260809 06:51:57.679843 11734 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:51:57 dist-test-slave-0b58 krb5kdc[11620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258317, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:51:57.683022 11734 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:51:57.684624 11734 webserver.cc:460] Webserver started at http://127.10.205.65:37591/ using document root <none> and password file <none>
I20260809 06:51:57.685328 11734 fs_manager.cc:359] Metadata directory not provided
I20260809 06:51:57.685470 11734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:51:57.685783 11734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:51:57.688915 11734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "34a86595e08c4fcd8e83a6f5efd00ccf"
format_stamp: "Formatted at 2026-08-09 06:51:57 on dist-test-slave-0b58"
server_key: "46f5b9860eb487e5bc852713507cb3a9"
server_key_iv: "3db26da09c15d4e89ccb14d444374ce6"
server_key_version: "encryptionkey@0"
I20260809 06:51:57.689859 11734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "34a86595e08c4fcd8e83a6f5efd00ccf"
format_stamp: "Formatted at 2026-08-09 06:51:57 on dist-test-slave-0b58"
server_key: "46f5b9860eb487e5bc852713507cb3a9"
server_key_iv: "3db26da09c15d4e89ccb14d444374ce6"
server_key_version: "encryptionkey@0"
I20260809 06:51:57.695499 11734 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:51:57.699107 11749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:57.700519 11734 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:51:57.700696 11734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "34a86595e08c4fcd8e83a6f5efd00ccf"
format_stamp: "Formatted at 2026-08-09 06:51:57 on dist-test-slave-0b58"
server_key: "46f5b9860eb487e5bc852713507cb3a9"
server_key_iv: "3db26da09c15d4e89ccb14d444374ce6"
server_key_version: "encryptionkey@0"
I20260809 06:51:57.700909 11734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:51:57.717733 11734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:51:57.721747 11734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:51:57.722066 11734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:51:57.723076 11734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:51:57.724517 11734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:51:57.724594 11734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:57.724768 11734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:51:57.724834 11734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:57.759004 11734 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:44257
I20260809 06:51:57.759053 11864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:44257 every 8 connection(s)
I20260809 06:51:57.760459 11734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:51:57.765412 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 11734
I20260809 06:51:57.765642 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:51:57.766289 11061 external_mini_cluster.cc:1428] Setting key 6cdf93ac249eadcf96af0d397a569983
Aug 09 06:51:57 dist-test-slave-0b58 krb5kdc[11620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258317, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:51:57.783069 11867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:57.763230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:51961 (local address 127.10.205.126:41463)
0809 06:51:57.763720 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:57.763724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:57.764582 (+ 858us) server_negotiation.cc:407] Connection header received
0809 06:51:57.766573 (+ 1991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:57.766579 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:57.766676 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:57.766806 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:57.768644 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:57.769373 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:57.770946 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:57.771373 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:57.771519 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:57.775698 (+ 4179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:57.775703 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:57.775706 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:57.775740 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:57.779372 (+ 3632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:57.780327 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:57.780335 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:57.780341 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:57.780498 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:57.780932 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:57.780940 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:57.780946 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:57.781364 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:57.781559 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:57.782266 (+ 707us) server_negotiation.cc:299] Negotiation successful
0809 06:51:57.782549 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":272,"threads_started":1}
I20260809 06:51:57.783715 11868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:57.763648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:41463 (local address 127.10.205.65:51961)
0809 06:51:57.764413 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0809 06:51:57.764453 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:51:57.766262 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:51:57.767100 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:51:57.767112 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:51:57.767727 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:51:57.768472 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:57.768492 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:57.769558 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:57.769562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:57.770794 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:57.770808 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:57.771642 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:57.771650 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:57.771880 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:57.772624 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:51:57.772651 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:51:57.775451 (+ 2800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:51:57.779538 (+ 4087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:51:57.779545 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:51:57.779559 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:51:57.780157 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:51:57.780611 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:51:57.780614 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:51:57.780617 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:51:57.780808 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:51:57.781494 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:51:57.781500 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:51:57.781854 (+ 354us) client_negotiation.cc:769] Sending connection context
0809 06:51:57.782089 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 06:51:57.782505 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":277,"threads_started":1}
I20260809 06:51:57.785590 11865 heartbeater.cc:347] Connected to a master server at 127.10.205.126:41463
I20260809 06:51:57.785914 11865 heartbeater.cc:464] Registering TS with master...
I20260809 06:51:57.786679 11865 heartbeater.cc:511] Master 127.10.205.126:41463 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
I20260809 06:51:57.789072 11670 ts_manager.cc:194] Registered new tserver with Master: 34a86595e08c4fcd8e83a6f5efd00ccf (127.10.205.65:44257)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
I20260809 06:51:57.790961 11670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:51961
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:51:57.814826 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:41463
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:35499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:51:58.146996 11871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:51:58.147269 11871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:51:58.147382 11871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:51:58.154805 11871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:51:58.154924 11871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:51:58.155056 11871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:51:58.165588 11871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:35499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:41463
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:51:58.166939 11871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:51:58.168275 11871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:51:58.181900 11877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:58.181991 11878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:58.182678 11880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:51:58.182678 11871 server_base.cc:1034] running on GCE node
I20260809 06:51:58.183405 11871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:51:58.184530 11871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:51:58.185786 11871 hybrid_clock.cc:648] HybridClock initialized: now 1786258318185703 us; error 69 us; skew 500 ppm
I20260809 06:51:58.186134 11871 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:51:58 dist-test-slave-0b58 krb5kdc[11620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258318, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:51:58.189570 11871 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:51:58.191237 11871 webserver.cc:460] Webserver started at http://127.10.205.66:39141/ using document root <none> and password file <none>
I20260809 06:51:58.192052 11871 fs_manager.cc:359] Metadata directory not provided
I20260809 06:51:58.192202 11871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:51:58.192574 11871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:51:58.195664 11871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "832af558fdbc419a834e681f48edea6e"
format_stamp: "Formatted at 2026-08-09 06:51:58 on dist-test-slave-0b58"
server_key: "784bfb92741573d0095f6038c9a0d569"
server_key_iv: "52dae7c1d131163b7f6bad2e910adcf9"
server_key_version: "encryptionkey@0"
I20260809 06:51:58.196563 11871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "832af558fdbc419a834e681f48edea6e"
format_stamp: "Formatted at 2026-08-09 06:51:58 on dist-test-slave-0b58"
server_key: "784bfb92741573d0095f6038c9a0d569"
server_key_iv: "52dae7c1d131163b7f6bad2e910adcf9"
server_key_version: "encryptionkey@0"
I20260809 06:51:58.201849 11871 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:51:58.205753 11887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:58.207137 11871 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:51:58.207350 11871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "832af558fdbc419a834e681f48edea6e"
format_stamp: "Formatted at 2026-08-09 06:51:58 on dist-test-slave-0b58"
server_key: "784bfb92741573d0095f6038c9a0d569"
server_key_iv: "52dae7c1d131163b7f6bad2e910adcf9"
server_key_version: "encryptionkey@0"
I20260809 06:51:58.207562 11871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:51:58.232779 11871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:51:58.237450 11871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:51:58.237777 11871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:51:58.238775 11871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:51:58.240120 11871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:51:58.240300 11871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:58.240466 11871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:51:58.240542 11871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:58.275177 11871 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:34287
I20260809 06:51:58.275238 12003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:34287 every 8 connection(s)
I20260809 06:51:58.276643 11871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:51:58.286418 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 11871
I20260809 06:51:58.286629 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:51:58.287236 11061 external_mini_cluster.cc:1428] Setting key 5261d1b85e3f59fa23754a12e38aff43
Aug 09 06:51:58 dist-test-slave-0b58 krb5kdc[11620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258318, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:51:58.299116 11867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.279216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:43935 (local address 127.10.205.126:41463)
0809 06:51:58.279403 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:58.279407 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:58.280694 (+ 1287us) server_negotiation.cc:407] Connection header received
0809 06:51:58.282559 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:58.282565 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:58.282669 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:58.282785 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:58.284349 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.285081 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.286773 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.287468 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.287619 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.291893 (+ 4274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:58.291902 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:58.291909 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:58.291956 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:58.295702 (+ 3746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:58.296621 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:58.296628 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:58.296634 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:58.296798 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:58.297334 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:58.297337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:58.297339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:58.297605 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:58.297726 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:58.298679 (+ 953us) server_negotiation.cc:299] Negotiation successful
0809 06:51:58.298872 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 06:51:58.300796 12006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.279739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:41463 (local address 127.10.205.66:43935)
0809 06:51:58.280538 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0809 06:51:58.280575 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 06:51:58.282276 (+ 1701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:51:58.283033 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:51:58.283041 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:51:58.283583 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:51:58.284143 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.284166 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.285269 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.285273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.286585 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.286601 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.287685 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.287691 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.287957 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.288809 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:51:58.288831 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:51:58.291643 (+ 2812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:51:58.295884 (+ 4241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:51:58.295891 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:51:58.295906 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:51:58.296477 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:51:58.296920 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:51:58.296928 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:51:58.296933 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:51:58.297216 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:51:58.297737 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:51:58.297750 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:51:58.298250 (+ 500us) client_negotiation.cc:769] Sending connection context
0809 06:51:58.298590 (+ 340us) client_negotiation.cc:240] Negotiation successful
0809 06:51:58.299211 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":266,"threads_started":1}
I20260809 06:51:58.302369 12004 heartbeater.cc:347] Connected to a master server at 127.10.205.126:41463
I20260809 06:51:58.302711 12004 heartbeater.cc:464] Registering TS with master...
I20260809 06:51:58.303696 12004 heartbeater.cc:511] Master 127.10.205.126:41463 requested a full tablet report, sending...
I20260809 06:51:58.305477 11670 ts_manager.cc:194] Registered new tserver with Master: 832af558fdbc419a834e681f48edea6e (127.10.205.66:34287)
I20260809 06:51:58.306422 11670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:43935
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:51:58.337010 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:41463
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:35499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:51:58.667608 12009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:51:58.667912 12009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:51:58.668015 12009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:51:58.675467 12009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:51:58.675587 12009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:51:58.675706 12009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:51:58.685684 12009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:35499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:41463
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:51:58.687077 12009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:51:58.688442 12009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:51:58.702234 12014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:58.702188 12016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:51:58.702157 12018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:51:58.703223 12009 server_base.cc:1034] running on GCE node
I20260809 06:51:58.703842 12009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:51:58.704933 12009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:51:58.706167 12009 hybrid_clock.cc:648] HybridClock initialized: now 1786258318706100 us; error 58 us; skew 500 ppm
I20260809 06:51:58.706516 12009 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:51:58 dist-test-slave-0b58 krb5kdc[11620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258318, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:51:58.709625 12009 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:51:58.711126 12009 webserver.cc:460] Webserver started at http://127.10.205.67:43567/ using document root <none> and password file <none>
I20260809 06:51:58.711853 12009 fs_manager.cc:359] Metadata directory not provided
I20260809 06:51:58.712004 12009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:51:58.712409 12009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:51:58.715335 12009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "9e10f9721adc4563b8b7818c45f62fbc"
format_stamp: "Formatted at 2026-08-09 06:51:58 on dist-test-slave-0b58"
server_key: "59056d6b757d043be6053778094e3104"
server_key_iv: "6e649c64d9178f14b499fe961213db95"
server_key_version: "encryptionkey@0"
I20260809 06:51:58.716143 12009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "9e10f9721adc4563b8b7818c45f62fbc"
format_stamp: "Formatted at 2026-08-09 06:51:58 on dist-test-slave-0b58"
server_key: "59056d6b757d043be6053778094e3104"
server_key_iv: "6e649c64d9178f14b499fe961213db95"
server_key_version: "encryptionkey@0"
I20260809 06:51:58.721293 12009 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 06:51:58.724673 12025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:58.725914 12009 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 06:51:58.726101 12009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "9e10f9721adc4563b8b7818c45f62fbc"
format_stamp: "Formatted at 2026-08-09 06:51:58 on dist-test-slave-0b58"
server_key: "59056d6b757d043be6053778094e3104"
server_key_iv: "6e649c64d9178f14b499fe961213db95"
server_key_version: "encryptionkey@0"
I20260809 06:51:58.726323 12009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:51:58.740758 12009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:51:58.744699 12009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:51:58.745014 12009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:51:58.745968 12009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:51:58.747390 12009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:51:58.747494 12009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:58.747646 12009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:51:58.747732 12009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:51:58.783320 12009 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:35941
I20260809 06:51:58.783373 12138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:35941 every 8 connection(s)
I20260809 06:51:58.784719 12009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:51:58.788105 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 12009
I20260809 06:51:58.788359 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:51:58.788893 11061 external_mini_cluster.cc:1428] Setting key 732f47415f572e11cc2f1d5223641b2e
I20260809 06:51:58.794121 11865 heartbeater.cc:503] Master 127.10.205.126:41463 was elected leader, sending a full tablet report...
Aug 09 06:51:58 dist-test-slave-0b58 krb5kdc[11620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258318, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:51:58.806211 11867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.787367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:45847 (local address 127.10.205.126:41463)
0809 06:51:58.787553 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:58.787558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:58.788978 (+ 1420us) server_negotiation.cc:407] Connection header received
0809 06:51:58.791326 (+ 2348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:58.791332 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:58.791455 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:58.791567 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:58.793255 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.794016 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.796137 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.796616 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.796755 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.800186 (+ 3431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:58.800192 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:58.800195 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:58.800228 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:58.802796 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:58.803644 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:58.803652 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:58.803655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:58.803840 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:58.804470 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:58.804474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:58.804478 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:58.804869 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:58.805032 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:58.805775 (+ 743us) server_negotiation.cc:299] Negotiation successful
0809 06:51:58.805947 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:51:58.807245 12141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.787892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:41463 (local address 127.10.205.67:45847)
0809 06:51:58.788799 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0809 06:51:58.788851 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 06:51:58.791025 (+ 2174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:51:58.791822 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:51:58.791830 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:51:58.792522 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:51:58.793087 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.793104 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.794194 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.794197 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.795981 (+ 1784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.795993 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.796861 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.796869 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.797119 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.797818 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:51:58.797841 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:51:58.799974 (+ 2133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:51:58.802945 (+ 2971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:51:58.802953 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:51:58.802970 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:51:58.803515 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:51:58.803954 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:51:58.803958 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:51:58.803981 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:51:58.804358 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:51:58.805014 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:51:58.805024 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:51:58.805403 (+ 379us) client_negotiation.cc:769] Sending connection context
0809 06:51:58.805682 (+ 279us) client_negotiation.cc:240] Negotiation successful
0809 06:51:58.806102 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":408,"threads_started":1}
I20260809 06:51:58.808610 12139 heartbeater.cc:347] Connected to a master server at 127.10.205.126:41463
I20260809 06:51:58.808935 12139 heartbeater.cc:464] Registering TS with master...
I20260809 06:51:58.809671 12139 heartbeater.cc:511] Master 127.10.205.126:41463 requested a full tablet report, sending...
I20260809 06:51:58.811113 11670 ts_manager.cc:194] Registered new tserver with Master: 9e10f9721adc4563b8b7818c45f62fbc (127.10.205.67:35941)
I20260809 06:51:58.812067 11670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:45847
I20260809 06:51:58.817166 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:51:58.836741 11867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.823457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51514 (local address 127.10.205.126:41463)
0809 06:51:58.823688 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:58.823696 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:58.824197 (+ 501us) server_negotiation.cc:407] Connection header received
0809 06:51:58.824453 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:58.824457 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:58.824534 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:58.824643 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:58.826209 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.826950 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.828292 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.828696 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.828834 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.831253 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:58.831258 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:58.831261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:58.831294 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:58.833887 (+ 2593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:58.834570 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:58.834582 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:58.834585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:58.834716 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:58.835106 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:58.835111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:58.835125 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:58.835454 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:58.835722 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:58.836054 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 06:51:58.836337 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 06:51:58.843199 11670 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51514:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:51:58.850085 11670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:51:58.874750 12154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.862780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:35941 (local address 127.0.0.1:51924)
0809 06:51:58.864458 (+ 1678us) negotiation.cc:107] Waiting for socket to connect
0809 06:51:58.864477 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:51:58.864578 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:51:58.866840 (+ 2262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:51:58.866847 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:51:58.866882 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:51:58.867406 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.867423 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.869410 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.869416 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.871768 (+ 2352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.871783 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.873768 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.873774 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.873970 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.874046 (+ 76us) client_negotiation.cc:769] Sending connection context
0809 06:51:58.874190 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 06:51:58.874386 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1557,"thread_start_us":4264,"threads_started":1}
I20260809 06:51:58.874851 12156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.863588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51924 (local address 127.10.205.67:35941)
0809 06:51:58.865380 (+ 1792us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:58.865393 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:58.865434 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:51:58.865556 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:58.865567 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:58.865874 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:58.866133 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:51:58.867632 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.869280 (+ 1648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.871975 (+ 2695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.873281 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.873390 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.873660 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:58.874270 (+ 610us) server_negotiation.cc:299] Negotiation successful
0809 06:51:58.874455 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1567,"thread_start_us":1380,"threads_started":1}
I20260809 06:51:58.876299 12152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.863136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:34287 (local address 127.0.0.1:43092)
0809 06:51:58.867367 (+ 4231us) negotiation.cc:107] Waiting for socket to connect
0809 06:51:58.867388 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:51:58.867596 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:51:58.868560 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:51:58.868564 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:51:58.868590 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:51:58.869350 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.869369 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.871320 (+ 1951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.871325 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.873486 (+ 2161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.873496 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.875454 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.875460 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.875635 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.875657 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 06:51:58.875756 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 06:51:58.875886 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4068,"mutex_wait_us":46,"thread_start_us":1442,"threads_started":1}
I20260809 06:51:58.876379 12158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.863700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43092 (local address 127.10.205.66:34287)
0809 06:51:58.866849 (+ 3149us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:58.866857 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:58.867486 (+ 629us) server_negotiation.cc:407] Connection header received
0809 06:51:58.867824 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:58.867833 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:58.868057 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:58.868282 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:51:58.869538 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.871160 (+ 1622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.873638 (+ 2478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.875195 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.875351 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.875566 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:58.875827 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 06:51:58.876007 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2985,"thread_start_us":2856,"threads_started":1}
I20260809 06:51:58.876982 12151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.862677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:44257 (local address 127.0.0.1:50996)
0809 06:51:58.863599 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0809 06:51:58.863648 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 06:51:58.863830 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:51:58.868407 (+ 4577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:51:58.868414 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:51:58.868445 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:51:58.868979 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.868993 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.870639 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.870646 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.873162 (+ 2516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.873178 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.875087 (+ 1909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.875093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.875394 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.875441 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 06:51:58.875528 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 06:51:58.875661 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"mutex_wait_us":3,"thread_start_us":1303,"threads_started":1}
I20260809 06:51:58.878079 12153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.863015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50996 (local address 127.10.205.65:44257)
0809 06:51:58.867809 (+ 4794us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:58.867817 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:58.867843 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:51:58.867929 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:58.867935 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:58.868158 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:58.869194 (+ 1036us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:51:58.869495 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.870496 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.873339 (+ 2843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.874671 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.874816 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.877497 (+ 2681us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:58.877572 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 06:51:58.877749 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4636,"thread_start_us":4437,"threads_started":1}
I20260809 06:51:58.879230 12074 tablet_service.cc:1467] Processing CreateTablet for tablet 9fea0ea2d02a4136990a8852db59643a (DEFAULT_TABLE table=test-table [id=abc4ad15310347ed9850cadee6ce14d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:51:58.879895 11937 tablet_service.cc:1467] Processing CreateTablet for tablet 9fea0ea2d02a4136990a8852db59643a (DEFAULT_TABLE table=test-table [id=abc4ad15310347ed9850cadee6ce14d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:51:58.880911 12074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fea0ea2d02a4136990a8852db59643a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:51:58.881299 11937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fea0ea2d02a4136990a8852db59643a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:51:58.881842 11799 tablet_service.cc:1467] Processing CreateTablet for tablet 9fea0ea2d02a4136990a8852db59643a (DEFAULT_TABLE table=test-table [id=abc4ad15310347ed9850cadee6ce14d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:51:58.883327 11799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fea0ea2d02a4136990a8852db59643a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:51:58.893429 12159 tablet_bootstrap.cc:492] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e: Bootstrap starting.
I20260809 06:51:58.897192 12160 tablet_bootstrap.cc:492] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc: Bootstrap starting.
I20260809 06:51:58.897245 12159 tablet_bootstrap.cc:654] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e: Neither blocks nor log segments found. Creating new log.
I20260809 06:51:58.899214 12159 log.cc:824] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:51:58.899914 12161 tablet_bootstrap.cc:492] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf: Bootstrap starting.
I20260809 06:51:58.901026 12160 tablet_bootstrap.cc:654] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc: Neither blocks nor log segments found. Creating new log.
I20260809 06:51:58.902195 12160 log.cc:824] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc: Log is configured to *not* fsync() on all Append() calls
I20260809 06:51:58.903324 12161 tablet_bootstrap.cc:654] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf: Neither blocks nor log segments found. Creating new log.
I20260809 06:51:58.903609 12159 tablet_bootstrap.cc:492] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e: No bootstrap required, opened a new log
I20260809 06:51:58.903913 12159 ts_tablet_manager.cc:1397] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260809 06:51:58.904523 12161 log.cc:824] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf: Log is configured to *not* fsync() on all Append() calls
I20260809 06:51:58.905805 12160 tablet_bootstrap.cc:492] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc: No bootstrap required, opened a new log
I20260809 06:51:58.906062 12160 ts_tablet_manager.cc:1397] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 06:51:58.907426 12161 tablet_bootstrap.cc:492] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf: No bootstrap required, opened a new log
I20260809 06:51:58.907689 12161 ts_tablet_manager.cc:1397] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 06:51:58.915118 12161 raft_consensus.cc:348] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e10f9721adc4563b8b7818c45f62fbc" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35941 } } peers { permanent_uuid: "34a86595e08c4fcd8e83a6f5efd00ccf" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 44257 } } peers { permanent_uuid: "832af558fdbc419a834e681f48edea6e" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 34287 } }
I20260809 06:51:58.915078 12159 raft_consensus.cc:348] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e10f9721adc4563b8b7818c45f62fbc" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35941 } } peers { permanent_uuid: "34a86595e08c4fcd8e83a6f5efd00ccf" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 44257 } } peers { permanent_uuid: "832af558fdbc419a834e681f48edea6e" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 34287 } }
I20260809 06:51:58.915518 12161 raft_consensus.cc:374] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:51:58.915575 12159 raft_consensus.cc:374] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:51:58.915604 12161 raft_consensus.cc:729] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a86595e08c4fcd8e83a6f5efd00ccf, State: Initialized, Role: FOLLOWER
I20260809 06:51:58.915669 12159 raft_consensus.cc:729] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832af558fdbc419a834e681f48edea6e, State: Initialized, Role: FOLLOWER
I20260809 06:51:58.916246 12161 consensus_queue.cc:260] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e10f9721adc4563b8b7818c45f62fbc" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35941 } } peers { permanent_uuid: "34a86595e08c4fcd8e83a6f5efd00ccf" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 44257 } } peers { permanent_uuid: "832af558fdbc419a834e681f48edea6e" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 34287 } }
I20260809 06:51:58.916283 12159 consensus_queue.cc:260] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e10f9721adc4563b8b7818c45f62fbc" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35941 } } peers { permanent_uuid: "34a86595e08c4fcd8e83a6f5efd00ccf" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 44257 } } peers { permanent_uuid: "832af558fdbc419a834e681f48edea6e" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 34287 } }
I20260809 06:51:58.917001 12160 raft_consensus.cc:348] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e10f9721adc4563b8b7818c45f62fbc" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35941 } } peers { permanent_uuid: "34a86595e08c4fcd8e83a6f5efd00ccf" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 44257 } } peers { permanent_uuid: "832af558fdbc419a834e681f48edea6e" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 34287 } }
I20260809 06:51:58.917451 12160 raft_consensus.cc:374] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:51:58.917578 12160 raft_consensus.cc:729] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e10f9721adc4563b8b7818c45f62fbc, State: Initialized, Role: FOLLOWER
I20260809 06:51:58.917734 12004 heartbeater.cc:503] Master 127.10.205.126:41463 was elected leader, sending a full tablet report...
I20260809 06:51:58.918372 12159 ts_tablet_manager.cc:1428] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e: Time spent starting tablet: real 0.014s user 0.012s sys 0.004s
I20260809 06:51:58.918344 12160 consensus_queue.cc:260] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e10f9721adc4563b8b7818c45f62fbc" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35941 } } peers { permanent_uuid: "34a86595e08c4fcd8e83a6f5efd00ccf" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 44257 } } peers { permanent_uuid: "832af558fdbc419a834e681f48edea6e" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 34287 } }
I20260809 06:51:58.921463 12161 ts_tablet_manager.cc:1428] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf: Time spent starting tablet: real 0.014s user 0.011s sys 0.000s
I20260809 06:51:58.923300 12139 heartbeater.cc:503] Master 127.10.205.126:41463 was elected leader, sending a full tablet report...
I20260809 06:51:58.925103 12160 ts_tablet_manager.cc:1428] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc: Time spent starting tablet: real 0.019s user 0.018s sys 0.000s
I20260809 06:51:58.927506 12167 raft_consensus.cc:482] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:51:58.927783 12167 raft_consensus.cc:504] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e10f9721adc4563b8b7818c45f62fbc" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35941 } } peers { permanent_uuid: "34a86595e08c4fcd8e83a6f5efd00ccf" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 44257 } } peers { permanent_uuid: "832af558fdbc419a834e681f48edea6e" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 34287 } }
I20260809 06:51:58.929370 12167 leader_election.cc:288] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a86595e08c4fcd8e83a6f5efd00ccf (127.10.205.65:44257), 832af558fdbc419a834e681f48edea6e (127.10.205.66:34287)
I20260809 06:51:58.935817 12141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.929617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:34287 (local address 127.10.205.67:42495)
0809 06:51:58.929856 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 06:51:58.929884 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 06:51:58.930004 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:51:58.930735 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:51:58.930740 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:51:58.930763 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:51:58.930975 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.930987 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.932028 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.932033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.934048 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.934065 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.935266 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.935271 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.935413 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.935438 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 06:51:58.935516 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 06:51:58.935609 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 06:51:58.935959 12158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.930276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:42495 (local address 127.10.205.66:34287)
0809 06:51:58.930459 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:58.930464 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:58.930477 (+ 13us) server_negotiation.cc:407] Connection header received
0809 06:51:58.930527 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:58.930530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:58.930582 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:58.930705 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:51:58.931125 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.931886 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.934216 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.935106 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.935269 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.935357 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:58.935563 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 06:51:58.935697 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:51:58.937064 12153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.929801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:46177 (local address 127.10.205.65:44257)
0809 06:51:58.930005 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:58.930012 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:58.930677 (+ 665us) server_negotiation.cc:407] Connection header received
0809 06:51:58.930905 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:58.930914 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:58.931024 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:58.931089 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:51:58.931874 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.932897 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.934908 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.936130 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.936320 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.936390 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:58.936675 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 06:51:58.936810 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:51:58.936952 11958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fea0ea2d02a4136990a8852db59643a" candidate_uuid: "9e10f9721adc4563b8b7818c45f62fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832af558fdbc419a834e681f48edea6e" is_pre_election: true
I20260809 06:51:58.937151 12168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.929779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:44257 (local address 127.10.205.67:46177)
0809 06:51:58.930547 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0809 06:51:58.930564 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:51:58.930734 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:51:58.931255 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:51:58.931258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:51:58.931276 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:51:58.931665 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.931682 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.933050 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.933056 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.934758 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:51:58.934769 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.936356 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.936363 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:51:58.936518 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.936541 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 06:51:58.936649 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 06:51:58.936772 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"spinlock_wait_cycles":16640,"thread_start_us":550,"threads_started":1}
I20260809 06:51:58.937474 11958 raft_consensus.cc:2454] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e10f9721adc4563b8b7818c45f62fbc in term 0.
I20260809 06:51:58.938146 12028 leader_election.cc:302] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 832af558fdbc419a834e681f48edea6e, 9e10f9721adc4563b8b7818c45f62fbc; no voters:
I20260809 06:51:58.938139 11819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fea0ea2d02a4136990a8852db59643a" candidate_uuid: "9e10f9721adc4563b8b7818c45f62fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a86595e08c4fcd8e83a6f5efd00ccf" is_pre_election: true
I20260809 06:51:58.938565 12167 raft_consensus.cc:2781] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:51:58.938710 12167 raft_consensus.cc:482] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:51:58.938630 11819 raft_consensus.cc:2454] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e10f9721adc4563b8b7818c45f62fbc in term 0.
I20260809 06:51:58.938840 12167 raft_consensus.cc:3037] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:51:58.941341 12167 raft_consensus.cc:504] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e10f9721adc4563b8b7818c45f62fbc" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35941 } } peers { permanent_uuid: "34a86595e08c4fcd8e83a6f5efd00ccf" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 44257 } } peers { permanent_uuid: "832af558fdbc419a834e681f48edea6e" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 34287 } }
I20260809 06:51:58.942035 12167 leader_election.cc:288] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [CANDIDATE]: Term 1 election: Requested vote from peers 34a86595e08c4fcd8e83a6f5efd00ccf (127.10.205.65:44257), 832af558fdbc419a834e681f48edea6e (127.10.205.66:34287)
I20260809 06:51:58.942476 11819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fea0ea2d02a4136990a8852db59643a" candidate_uuid: "9e10f9721adc4563b8b7818c45f62fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a86595e08c4fcd8e83a6f5efd00ccf"
I20260809 06:51:58.942669 11819 raft_consensus.cc:3037] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:51:58.942659 11958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fea0ea2d02a4136990a8852db59643a" candidate_uuid: "9e10f9721adc4563b8b7818c45f62fbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "832af558fdbc419a834e681f48edea6e"
I20260809 06:51:58.942878 11958 raft_consensus.cc:3037] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:51:58.944973 11819 raft_consensus.cc:2454] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e10f9721adc4563b8b7818c45f62fbc in term 1.
I20260809 06:51:58.945180 11958 raft_consensus.cc:2454] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e10f9721adc4563b8b7818c45f62fbc in term 1.
I20260809 06:51:58.945410 12026 leader_election.cc:302] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a86595e08c4fcd8e83a6f5efd00ccf, 9e10f9721adc4563b8b7818c45f62fbc; no voters:
I20260809 06:51:58.945757 12167 raft_consensus.cc:2781] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:51:58.946262 12167 raft_consensus.cc:686] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [term 1 LEADER]: Becoming Leader. State: Replica: 9e10f9721adc4563b8b7818c45f62fbc, State: Running, Role: LEADER
I20260809 06:51:58.946736 12167 consensus_queue.cc:237] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e10f9721adc4563b8b7818c45f62fbc" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35941 } } peers { permanent_uuid: "34a86595e08c4fcd8e83a6f5efd00ccf" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 44257 } } peers { permanent_uuid: "832af558fdbc419a834e681f48edea6e" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 34287 } }
I20260809 06:51:58.951542 11668 catalog_manager.cc:5495] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e10f9721adc4563b8b7818c45f62fbc (127.10.205.67). New cstate: current_term: 1 leader_uuid: "9e10f9721adc4563b8b7818c45f62fbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e10f9721adc4563b8b7818c45f62fbc" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a86595e08c4fcd8e83a6f5efd00ccf" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 44257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "832af558fdbc419a834e681f48edea6e" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 34287 } health_report { overall_health: UNKNOWN } } }
Aug 09 06:51:58 dist-test-slave-0b58 krb5kdc[11620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:51:58.986503 12153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:58.970815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51010 (local address 127.10.205.65:44257)
0809 06:51:58.971056 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:58.971064 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:58.971465 (+ 401us) server_negotiation.cc:407] Connection header received
0809 06:51:58.971684 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:58.971688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:58.971752 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:58.971861 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:58.973546 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.974341 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.975617 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:58.976064 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:58.976207 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:58.980805 (+ 4598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:58.980821 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:58.980838 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:58.980874 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:58.983603 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:58.984334 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:58.984341 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:58.984344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:58.984476 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:58.984878 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:58.984883 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:58.984887 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:58.985281 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:58.985608 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:58.985895 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 06:51:58.986135 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 06:51:59.013159 11866 tablet.cc:2369] T 9fea0ea2d02a4136990a8852db59643a P 34a86595e08c4fcd8e83a6f5efd00ccf: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 06:51:59 dist-test-slave-0b58 krb5kdc[11620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258319, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260809 06:51:59.028746 12005 tablet.cc:2369] T 9fea0ea2d02a4136990a8852db59643a P 832af558fdbc419a834e681f48edea6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 06:51:59 dist-test-slave-0b58 krb5kdc[11620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258319, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
W20260809 06:51:59.036425 12140 tablet.cc:2369] T 9fea0ea2d02a4136990a8852db59643a P 9e10f9721adc4563b8b7818c45f62fbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:51:59.040616 12153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:59.026324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51014 (local address 127.10.205.65:44257)
0809 06:51:59.026504 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:59.026508 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:59.026939 (+ 431us) server_negotiation.cc:407] Connection header received
0809 06:51:59.027089 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:59.027093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:59.027157 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:59.027253 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:59.028712 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:59.029541 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:59.030845 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:59.031308 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:59.031405 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:59.035368 (+ 3963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:59.035373 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:59.035376 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:59.035411 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:59.038260 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:59.038856 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:59.038860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:59.038862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:59.038988 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:59.039333 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:59.039336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:59.039338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:59.039591 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:59.039808 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:59.040004 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 06:51:59.040188 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 06:51:59 dist-test-slave-0b58 krb5kdc[11620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 06:51:59 dist-test-slave-0b58 krb5kdc[11620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:51:59.092010 12153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:59.077189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51028 (local address 127.10.205.65:44257)
0809 06:51:59.077431 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:59.077439 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:59.077759 (+ 320us) server_negotiation.cc:407] Connection header received
0809 06:51:59.077989 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:59.077993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:59.078061 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:59.078175 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:59.079801 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:59.080628 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:59.081862 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:59.082293 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:59.082437 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:59.086439 (+ 4002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:59.086445 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:59.086448 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:59.086484 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:59.089044 (+ 2560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:59.089749 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:59.089754 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:59.089758 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:59.089903 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:59.090299 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:59.090307 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:59.090311 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:59.090711 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:59.090977 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:59.091358 (+ 381us) server_negotiation.cc:299] Negotiation successful
0809 06:51:59.091624 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 06:51:59.093890 11779 tablet_service.cc:2908] Rejecting scan request for tablet 9fea0ea2d02a4136990a8852db59643a: Uninitialized: clean time has not yet been initialized
I20260809 06:51:59.096936 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 11734
I20260809 06:51:59.109673 12153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:59.097923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51040 (local address 127.10.205.65:44257)
0809 06:51:59.098096 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:59.098101 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:59.098521 (+ 420us) server_negotiation.cc:407] Connection header received
0809 06:51:59.098649 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:59.098652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:59.098720 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:59.098813 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:59.099960 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:59.100681 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:59.101805 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:59.102212 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:59.102320 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:59.104495 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:59.104500 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:59.104503 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:59.104532 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:59.107233 (+ 2701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:59.107952 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:59.107959 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:59.107962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:59.108088 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:59.108535 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:59.108539 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:59.108541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:59.108834 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:59.109053 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:59.109286 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 06:51:59.109457 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:51:59.110314 11860 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:51:59.210070 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 11734
I20260809 06:51:59.229171 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 11871
Aug 09 06:51:59 dist-test-slave-0b58 krb5kdc[11620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:51:59.243628 12158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:59.230144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43098 (local address 127.10.205.66:34287)
0809 06:51:59.230341 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:59.230346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:59.230418 (+ 72us) server_negotiation.cc:407] Connection header received
0809 06:51:59.230704 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:59.230713 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:59.230815 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:59.230954 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:59.232106 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:59.232943 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:59.234125 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:59.234511 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:59.234602 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:59.238534 (+ 3932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:59.238549 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:59.238565 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:59.238599 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:59.241344 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:59.241950 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:59.241957 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:59.241960 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:59.242078 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:59.242396 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:59.242399 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:59.242401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:59.242748 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:59.243010 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:59.243205 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 06:51:59.243375 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 06:51:59.244408 11999 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:51:59.332669 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 11871
I20260809 06:51:59.351274 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 12009
Aug 09 06:51:59 dist-test-slave-0b58 krb5kdc[11620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:51:59.367015 12156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:51:59.352103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51938 (local address 127.10.205.67:35941)
0809 06:51:59.352344 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 06:51:59.352351 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:51:59.352391 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:51:59.352600 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:51:59.352605 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:51:59.352681 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:51:59.352810 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:51:59.354063 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:59.354808 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:59.356108 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:51:59.356596 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:51:59.356731 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:51:59.361048 (+ 4317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:51:59.361063 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:51:59.361080 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:51:59.361115 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:51:59.363941 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:59.364879 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:59.364886 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:59.364889 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:59.365027 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:51:59.365436 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:51:59.365442 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:51:59.365450 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:51:59.365804 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:51:59.366132 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0809 06:51:59.366420 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 06:51:59.366671 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 06:51:59.367749 12134 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:51:59.457823 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 12009
I20260809 06:51:59.476948 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 11634
I20260809 06:51:59.478231 11701 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:51:59.588637 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 11634
2026-08-09T06:51:59Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4225 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:51:59 dist-test-slave-0b58 krb5kdc[12189](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:51:59 dist-test-slave-0b58 krb5kdc[12189](info): set up 2 sockets
Aug 09 06:51:59 dist-test-slave-0b58 krb5kdc[12189](info): commencing operation
krb5kdc: starting...
W20260809 06:52:00.730932 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.001s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:52:00 dist-test-slave-0b58 krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:52:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:52:00.939178 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:38551
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:38551
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:01.264279 12202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:01.264631 12202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:01.264797 12202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:01.272337 12202 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:01.272480 12202 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 06:52:01.272555 12202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:01.272652 12202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:01.272751 12202 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:01.272841 12202 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:01.282644 12202 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:38551
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:38551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:01.283991 12202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:01.285341 12202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:01.297515 12207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:01.297559 12211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:01.297581 12208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:01.298616 12202 server_base.cc:1034] running on GCE node
I20260809 06:52:01.299443 12202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:01.300912 12202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:01.302156 12202 hybrid_clock.cc:648] HybridClock initialized: now 1786258321302068 us; error 62 us; skew 500 ppm
I20260809 06:52:01.302495 12202 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:01 dist-test-slave-0b58 krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258321, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:01.305709 12202 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:52:01.307143 12202 webserver.cc:460] Webserver started at http://127.10.205.126:42947/ using document root <none> and password file <none>
I20260809 06:52:01.307889 12202 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:01.308023 12202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:01.308415 12202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:01.311321 12202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "eb11abe0267149f58349d8290e91ec92"
format_stamp: "Formatted at 2026-08-09 06:52:01 on dist-test-slave-0b58"
server_key: "a56c6c09537be60c4a0c1977e4832be4"
server_key_iv: "87fef814512f3c7edf11a4cc214ac387"
server_key_version: "encryptionkey@0"
I20260809 06:52:01.312124 12202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "eb11abe0267149f58349d8290e91ec92"
format_stamp: "Formatted at 2026-08-09 06:52:01 on dist-test-slave-0b58"
server_key: "a56c6c09537be60c4a0c1977e4832be4"
server_key_iv: "87fef814512f3c7edf11a4cc214ac387"
server_key_version: "encryptionkey@0"
I20260809 06:52:01.317361 12202 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:52:01.320715 12218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:01.322009 12202 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 06:52:01.322199 12202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "eb11abe0267149f58349d8290e91ec92"
format_stamp: "Formatted at 2026-08-09 06:52:01 on dist-test-slave-0b58"
server_key: "a56c6c09537be60c4a0c1977e4832be4"
server_key_iv: "87fef814512f3c7edf11a4cc214ac387"
server_key_version: "encryptionkey@0"
I20260809 06:52:01.322441 12202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:01.333614 12202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:01.337984 12202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:01.338266 12202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:01.359954 12202 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:38551
I20260809 06:52:01.359961 12284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:38551 every 8 connection(s)
I20260809 06:52:01.361392 12202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:01.365033 12285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:01.369473 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 12202
I20260809 06:52:01.369710 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:01.370397 11061 external_mini_cluster.cc:1428] Setting key 8f4646237951cc266026335dcea901ce
I20260809 06:52:01.377494 12285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92: Bootstrap starting.
I20260809 06:52:01.381240 12285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:01.382385 12285 log.cc:824] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:01.385529 12285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92: No bootstrap required, opened a new log
Aug 09 06:52:01 dist-test-slave-0b58 krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:01.396234 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:01.372677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36150 (local address 127.10.205.126:38551)
0809 06:52:01.373564 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:01.373580 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:01.373647 (+ 67us) server_negotiation.cc:407] Connection header received
0809 06:52:01.376179 (+ 2532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:01.376213 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:01.376858 (+ 645us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:01.377311 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:01.378676 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:01.380740 (+ 2064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:01.382055 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:01.383209 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:01.383362 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:01.387640 (+ 4278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:01.387650 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:01.387670 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:01.387713 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:01.391735 (+ 4022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:01.392455 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:01.392468 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:01.392476 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:01.392692 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:01.393047 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:01.393054 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:01.393059 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:01.393776 (+ 717us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:01.394099 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:01.394418 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 06:52:01.394896 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":339,"threads_started":1}
I20260809 06:52:01.396013 12285 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb11abe0267149f58349d8290e91ec92" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38551 } }
I20260809 06:52:01.396598 12285 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:01.396709 12285 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb11abe0267149f58349d8290e91ec92, State: Initialized, Role: FOLLOWER
I20260809 06:52:01.397365 12285 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb11abe0267149f58349d8290e91ec92" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38551 } }
I20260809 06:52:01.397639 12285 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:01.397812 12285 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:01.397993 12285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:01.400359 12285 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb11abe0267149f58349d8290e91ec92" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38551 } }
I20260809 06:52:01.400859 12285 leader_election.cc:302] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb11abe0267149f58349d8290e91ec92; no voters:
I20260809 06:52:01.401527 12285 leader_election.cc:288] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:01.401647 12290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:01.402376 12290 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [term 1 LEADER]: Becoming Leader. State: Replica: eb11abe0267149f58349d8290e91ec92, State: Running, Role: LEADER
I20260809 06:52:01.402951 12290 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb11abe0267149f58349d8290e91ec92" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38551 } }
I20260809 06:52:01.403748 12285 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:01.406049 12291 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb11abe0267149f58349d8290e91ec92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb11abe0267149f58349d8290e91ec92" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38551 } } }
I20260809 06:52:01.406452 12291 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:01.408533 12292 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb11abe0267149f58349d8290e91ec92. Latest consensus state: current_term: 1 leader_uuid: "eb11abe0267149f58349d8290e91ec92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb11abe0267149f58349d8290e91ec92" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38551 } } }
I20260809 06:52:01.408875 12292 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:01.409513 12296 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:01.414321 12296 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:01.424649 12296 catalog_manager.cc:1347] Generated new cluster ID: 077735e8b2564d58a480a5488be720e6
I20260809 06:52:01.424773 12296 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:01.450485 12296 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:01.452528 12296 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:01.461863 12296 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92: Generated new TSK 0
I20260809 06:52:01.462702 12296 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:52:01.528169 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:38551
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:01.876048 12313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:01.876389 12313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:01.876502 12313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:01.883797 12313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:01.883912 12313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:01.884042 12313 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:52:01.884166 12313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:52:01.894371 12313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.205.126:38551
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:01.895828 12313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:01.897199 12313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:01.910827 12318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:01.910795 12321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:01.910868 12319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:01.911860 12313 server_base.cc:1034] running on GCE node
I20260809 06:52:01.912530 12313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:01.913470 12313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:01.914703 12313 hybrid_clock.cc:648] HybridClock initialized: now 1786258321914629 us; error 52 us; skew 500 ppm
I20260809 06:52:01.914995 12313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:01 dist-test-slave-0b58 krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258321, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:01.918143 12313 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:52:01.919605 12313 webserver.cc:460] Webserver started at http://127.10.205.65:41237/ using document root <none> and password file <none>
I20260809 06:52:01.920377 12313 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:01.920509 12313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:01.920833 12313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:01.923820 12313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "7e560c856b3946019a325f733689a825"
format_stamp: "Formatted at 2026-08-09 06:52:01 on dist-test-slave-0b58"
server_key: "ac7350e345cbc73351a669c88e5cfdeb"
server_key_iv: "00e32edab65138ffa87e98735ff2a992"
server_key_version: "encryptionkey@0"
I20260809 06:52:01.924656 12313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "7e560c856b3946019a325f733689a825"
format_stamp: "Formatted at 2026-08-09 06:52:01 on dist-test-slave-0b58"
server_key: "ac7350e345cbc73351a669c88e5cfdeb"
server_key_iv: "00e32edab65138ffa87e98735ff2a992"
server_key_version: "encryptionkey@0"
I20260809 06:52:01.929870 12313 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 06:52:01.933178 12328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:01.934451 12313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:52:01.934626 12313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "7e560c856b3946019a325f733689a825"
format_stamp: "Formatted at 2026-08-09 06:52:01 on dist-test-slave-0b58"
server_key: "ac7350e345cbc73351a669c88e5cfdeb"
server_key_iv: "00e32edab65138ffa87e98735ff2a992"
server_key_version: "encryptionkey@0"
I20260809 06:52:01.934861 12313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:01.963238 12313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:01.967401 12313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:01.967680 12313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:01.970445 12313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:01.970559 12313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:01.970726 12313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:01.970806 12313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:52:01 dist-test-slave-0b58 krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258321, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:01.995545 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:01.971525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:38605 (local address 127.10.205.126:38551)
0809 06:52:01.972001 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:01.972006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:01.973084 (+ 1078us) server_negotiation.cc:407] Connection header received
0809 06:52:01.975077 (+ 1993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:01.975084 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:01.975177 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:01.975309 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:01.977812 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:01.978854 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:01.981570 (+ 2716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:01.981997 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:01.982075 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:01.987634 (+ 5559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:01.987640 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:01.987643 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:01.987676 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:01.991115 (+ 3439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:01.992342 (+ 1227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:01.992351 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:01.992356 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:01.992520 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:01.993115 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:01.993123 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:01.993130 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:01.993559 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:01.993738 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:01.994745 (+ 1007us) server_negotiation.cc:299] Negotiation successful
0809 06:52:01.995043 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":272,"threads_started":1}
I20260809 06:52:01.997078 12338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:01.972070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:38551 (local address 127.10.205.65:38605)
0809 06:52:01.972926 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:01.972966 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:01.974807 (+ 1841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:01.975627 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:01.975642 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:01.976473 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:01.977527 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:01.977580 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:01.979089 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:01.979094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:01.981328 (+ 2234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:01.981348 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:01.982568 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:01.982585 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:01.982818 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:01.983705 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:01.983746 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:01.987360 (+ 3614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:01.991320 (+ 3960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:01.991334 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:01.991356 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:01.992155 (+ 799us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:01.992654 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:01.992659 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:01.992663 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:01.992955 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:01.993741 (+ 786us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:01.993750 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:01.994186 (+ 436us) client_negotiation.cc:769] Sending connection context
0809 06:52:01.994575 (+ 389us) client_negotiation.cc:240] Negotiation successful
0809 06:52:01.995271 (+ 696us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":387,"threads_started":1}
I20260809 06:52:02.020823 12313 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:35943
I20260809 06:52:02.020843 12456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:35943 every 8 connection(s)
I20260809 06:52:02.022405 12313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:52:02.024972 12457 heartbeater.cc:347] Connected to a master server at 127.10.205.126:38551
I20260809 06:52:02.025250 12457 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:02.026175 12457 heartbeater.cc:511] Master 127.10.205.126:38551 requested a full tablet report, sending...
I20260809 06:52:02.028189 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:02.008353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:42029 (local address 127.10.205.126:38551)
0809 06:52:02.008570 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:02.008578 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:02.013051 (+ 4473us) server_negotiation.cc:407] Connection header received
0809 06:52:02.013191 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:02.013199 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:02.013304 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:02.013426 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:02.015011 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:02.016319 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:02.018399 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:02.019027 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:02.019164 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:02.021501 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:02.021507 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:02.021512 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:02.021551 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:02.025124 (+ 3573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:02.026038 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:02.026042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:02.026044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:02.026226 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:02.026602 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:02.026606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:02.026610 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:02.026914 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:02.027079 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:02.027566 (+ 487us) server_negotiation.cc:299] Negotiation successful
0809 06:52:02.027800 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 06:52:02.028235 12431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:02.008386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:38551 (local address 127.10.205.65:42029)
0809 06:52:02.012931 (+ 4545us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:02.012949 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:02.013081 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:02.013497 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:02.013504 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:02.014274 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:02.014816 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:02.014834 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:02.016525 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:02.016533 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:02.018193 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:02.018210 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:02.019227 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:02.019232 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:02.019463 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:02.020301 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:02.020332 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:02.021299 (+ 967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:02.025255 (+ 3956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:02.025262 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:02.025269 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:02.025894 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:02.026346 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:02.026351 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:02.026355 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:02.026491 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:02.027061 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:02.027066 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:02.027313 (+ 247us) client_negotiation.cc:769] Sending connection context
0809 06:52:02.027457 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 06:52:02.027776 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4336,"thread_start_us":4183,"threads_started":1}
I20260809 06:52:02.028244 12235 ts_manager.cc:194] Registered new tserver with Master: 7e560c856b3946019a325f733689a825 (127.10.205.65:35943)
I20260809 06:52:02.029800 12235 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:38605
I20260809 06:52:02.032785 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 12313
I20260809 06:52:02.033032 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:52:02.033910 11061 external_mini_cluster.cc:1428] Setting key 86597ac96fe1ed197b8c43e2a476d7c1
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:52:02.079807 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:38551
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:02.418776 12461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:02.419072 12461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:02.419171 12461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:02.426951 12461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:02.427115 12461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:02.427234 12461 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:52:02.427327 12461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:52:02.438309 12461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.205.126:38551
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:02.439700 12461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:02.441164 12461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:02.454629 12467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:02.454670 12466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:02.454586 12469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:02.455411 12461 server_base.cc:1034] running on GCE node
I20260809 06:52:02.456095 12461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:02.457098 12461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:02.458355 12461 hybrid_clock.cc:648] HybridClock initialized: now 1786258322458281 us; error 44 us; skew 500 ppm
I20260809 06:52:02.458671 12461 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:02 dist-test-slave-0b58 krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258322, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:02.461890 12461 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:52:02.463524 12461 webserver.cc:460] Webserver started at http://127.10.205.66:44339/ using document root <none> and password file <none>
I20260809 06:52:02.464195 12461 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:02.464354 12461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:02.464655 12461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:02.467631 12461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "276ad2a2f2174bceb043ebc5154cb12f"
format_stamp: "Formatted at 2026-08-09 06:52:02 on dist-test-slave-0b58"
server_key: "ed0bde96e70375d22f882c9c66e1576b"
server_key_iv: "d23aa4881ee8193e06f4285ced9d21c9"
server_key_version: "encryptionkey@0"
I20260809 06:52:02.468602 12461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "276ad2a2f2174bceb043ebc5154cb12f"
format_stamp: "Formatted at 2026-08-09 06:52:02 on dist-test-slave-0b58"
server_key: "ed0bde96e70375d22f882c9c66e1576b"
server_key_iv: "d23aa4881ee8193e06f4285ced9d21c9"
server_key_version: "encryptionkey@0"
I20260809 06:52:02.473950 12461 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:52:02.477447 12476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:02.478806 12461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:52:02.478986 12461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "276ad2a2f2174bceb043ebc5154cb12f"
format_stamp: "Formatted at 2026-08-09 06:52:02 on dist-test-slave-0b58"
server_key: "ed0bde96e70375d22f882c9c66e1576b"
server_key_iv: "d23aa4881ee8193e06f4285ced9d21c9"
server_key_version: "encryptionkey@0"
I20260809 06:52:02.479231 12461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:02.492472 12461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:02.496622 12461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:02.496924 12461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:02.500113 12461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:02.500202 12461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:02.500388 12461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:02.500465 12461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:52:02 dist-test-slave-0b58 krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258322, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:02.524123 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:02.500894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:37143 (local address 127.10.205.126:38551)
0809 06:52:02.501098 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:02.501104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:02.502602 (+ 1498us) server_negotiation.cc:407] Connection header received
0809 06:52:02.505207 (+ 2605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:02.505214 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:02.505329 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:02.505407 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:02.507708 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:02.508860 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:02.510516 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:02.510972 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:02.511113 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:02.516044 (+ 4931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:02.516049 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:02.516053 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:02.516086 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:02.519763 (+ 3677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:02.520896 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:02.520904 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:02.520907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:02.521060 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:02.521754 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:02.521764 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:02.521770 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:02.522250 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:02.522455 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:02.523511 (+ 1056us) server_negotiation.cc:299] Negotiation successful
0809 06:52:02.523748 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 06:52:02.525393 12487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:02.501507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:38551 (local address 127.10.205.66:37143)
0809 06:52:02.502412 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:02.502462 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:02.504836 (+ 2374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:02.505823 (+ 987us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:02.505831 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:02.506529 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:02.507514 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:02.507538 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:02.509013 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:02.509019 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:02.510364 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:02.510377 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:02.511223 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:02.511231 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:02.511460 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:02.512336 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:02.512374 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:02.515730 (+ 3356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:02.519928 (+ 4198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:02.519937 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:02.519954 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:02.520677 (+ 723us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:02.521200 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:02.521205 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:02.521219 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:02.521577 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:02.522444 (+ 867us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:02.522454 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:02.522970 (+ 516us) client_negotiation.cc:769] Sending connection context
0809 06:52:02.523377 (+ 407us) client_negotiation.cc:240] Negotiation successful
0809 06:52:02.523988 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":377,"threads_started":1}
I20260809 06:52:02.549952 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:02.532189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:44409 (local address 127.10.205.126:38551)
0809 06:52:02.532383 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:02.532388 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:02.533331 (+ 943us) server_negotiation.cc:407] Connection header received
0809 06:52:02.533532 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:02.533539 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:02.533661 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:02.533763 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:02.535434 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:02.536167 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:02.538875 (+ 2708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:02.539648 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:02.539828 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:02.542928 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:02.542941 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:02.542945 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:02.542977 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:02.546516 (+ 3539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:02.547315 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:02.547323 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:02.547327 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:02.547501 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:02.548021 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:02.548029 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:02.548036 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:02.548613 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:02.548822 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:02.549349 (+ 527us) server_negotiation.cc:299] Negotiation successful
0809 06:52:02.549580 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 06:52:02.550060 12544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:02.532502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:38551 (local address 127.10.205.66:44409)
0809 06:52:02.533210 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:02.533229 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:02.533398 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:02.533957 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:02.533962 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:02.534726 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:02.535260 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:02.535278 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:02.536334 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:02.536342 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:02.538684 (+ 2342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:02.538700 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:02.539896 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:02.539906 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:02.540185 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:02.541083 (+ 898us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:02.541116 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:02.542698 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:02.546649 (+ 3951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:02.546653 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:02.546655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:02.547103 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:02.547635 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:02.547645 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:02.547649 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:02.547865 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:02.548765 (+ 900us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:02.548772 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:02.549035 (+ 263us) client_negotiation.cc:769] Sending connection context
0809 06:52:02.549228 (+ 193us) client_negotiation.cc:240] Negotiation successful
0809 06:52:02.549602 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":409,"threads_started":1}
I20260809 06:52:02.559068 12461 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:43183
I20260809 06:52:02.559100 12607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:43183 every 8 connection(s)
I20260809 06:52:02.560427 12461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:52:02.562542 12608 heartbeater.cc:347] Connected to a master server at 127.10.205.126:38551
I20260809 06:52:02.562736 12608 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:02.563340 12608 heartbeater.cc:511] Master 127.10.205.126:38551 requested a full tablet report, sending...
I20260809 06:52:02.564661 12234 ts_manager.cc:194] Registered new tserver with Master: 276ad2a2f2174bceb043ebc5154cb12f (127.10.205.66:43183)
I20260809 06:52:02.564667 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 12461
I20260809 06:52:02.564910 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:52:02.565378 11061 external_mini_cluster.cc:1428] Setting key c721f4bccd295ff805a206b64ccb7d41
I20260809 06:52:02.565670 12234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:37143
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:52:02.611581 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:38551
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:02.946156 12612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:02.946449 12612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:02.946550 12612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:02.953763 12612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:02.953881 12612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:02.953969 12612 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:52:02.954051 12612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:52:02.963928 12612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.205.126:38551
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:02.965270 12612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:02.966634 12612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:02.980500 12618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:02.980286 12621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:02.980407 12619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:02.981681 12612 server_base.cc:1034] running on GCE node
I20260809 06:52:02.982353 12612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:02.983405 12612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:02.984632 12612 hybrid_clock.cc:648] HybridClock initialized: now 1786258322984572 us; error 53 us; skew 500 ppm
I20260809 06:52:02.984972 12612 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:02 dist-test-slave-0b58 krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258322, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:02.988134 12612 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:52:02.989686 12612 webserver.cc:460] Webserver started at http://127.10.205.67:34817/ using document root <none> and password file <none>
I20260809 06:52:02.990481 12612 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:02.990613 12612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:02.990963 12612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:02.994074 12612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "161ca27a7b664a08a88f9ab3c5b3a746"
format_stamp: "Formatted at 2026-08-09 06:52:02 on dist-test-slave-0b58"
server_key: "c4d79b14fc35e765a826e086fd2ab603"
server_key_iv: "95555b3bcab11cfc21e349739490aa9b"
server_key_version: "encryptionkey@0"
I20260809 06:52:02.994926 12612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "161ca27a7b664a08a88f9ab3c5b3a746"
format_stamp: "Formatted at 2026-08-09 06:52:02 on dist-test-slave-0b58"
server_key: "c4d79b14fc35e765a826e086fd2ab603"
server_key_iv: "95555b3bcab11cfc21e349739490aa9b"
server_key_version: "encryptionkey@0"
I20260809 06:52:03.000576 12612 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260809 06:52:03.004148 12631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:03.005585 12612 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:03.005771 12612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "161ca27a7b664a08a88f9ab3c5b3a746"
format_stamp: "Formatted at 2026-08-09 06:52:02 on dist-test-slave-0b58"
server_key: "c4d79b14fc35e765a826e086fd2ab603"
server_key_iv: "95555b3bcab11cfc21e349739490aa9b"
server_key_version: "encryptionkey@0"
I20260809 06:52:03.006011 12612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:03.033459 12457 heartbeater.cc:503] Master 127.10.205.126:38551 was elected leader, sending a full tablet report...
I20260809 06:52:03.040606 12612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:03.044713 12612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:03.044950 12612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:03.047494 12612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:03.047618 12612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:03.047762 12612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:03.047854 12612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:52:03 dist-test-slave-0b58 krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258322, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:03.072553 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.048480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:60271 (local address 127.10.205.126:38551)
0809 06:52:03.048705 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:03.048710 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:03.050186 (+ 1476us) server_negotiation.cc:407] Connection header received
0809 06:52:03.052253 (+ 2067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:03.052278 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:03.052376 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:03.052497 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:03.054684 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.055846 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.058712 (+ 2866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.059317 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.059461 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.064792 (+ 5331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:03.064799 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:03.064803 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:03.064837 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:03.068502 (+ 3665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:03.069687 (+ 1185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:03.069690 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:03.069693 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:03.069862 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:03.070472 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:03.070478 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:03.070482 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:03.070804 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:03.070962 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:03.071878 (+ 916us) server_negotiation.cc:299] Negotiation successful
0809 06:52:03.072129 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260809 06:52:03.074344 12640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.049107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:38551 (local address 127.10.205.67:60271)
0809 06:52:03.050019 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:03.050060 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:03.051964 (+ 1904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:03.052745 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:03.052753 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:03.053530 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:03.054501 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.054532 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.056036 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.056044 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.058494 (+ 2450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.058512 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.059566 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.059573 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.059926 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.060884 (+ 958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:03.060910 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:03.064523 (+ 3613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:03.068715 (+ 4192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:03.068732 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:03.068755 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:03.069514 (+ 759us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:03.070025 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:03.070030 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:03.070035 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:03.070335 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:03.070939 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:03.070947 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:03.071406 (+ 459us) client_negotiation.cc:769] Sending connection context
0809 06:52:03.071713 (+ 307us) client_negotiation.cc:240] Negotiation successful
0809 06:52:03.072315 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":400,"threads_started":1}
I20260809 06:52:03.103057 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.087778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:36351 (local address 127.10.205.126:38551)
0809 06:52:03.088032 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:03.088041 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:03.088699 (+ 658us) server_negotiation.cc:407] Connection header received
0809 06:52:03.089049 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:03.089058 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:03.089159 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:03.089284 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:03.090683 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.091680 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.093890 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.094523 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.094669 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.096730 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:03.096735 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:03.096738 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:03.096767 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:03.100096 (+ 3329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:03.101029 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:03.101037 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:03.101041 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:03.101173 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:03.101550 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:03.101554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:03.101558 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:03.101843 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:03.102005 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:03.102440 (+ 435us) server_negotiation.cc:299] Negotiation successful
0809 06:52:03.102670 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 06:52:03.103155 12726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.087762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:38551 (local address 127.10.205.67:36351)
0809 06:52:03.088581 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:03.088605 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:03.088859 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:03.089348 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:03.089352 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:03.090009 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:03.090458 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.090478 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.091906 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.091915 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.093722 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.093735 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.094746 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.094752 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.094914 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.095688 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:03.095705 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:03.096520 (+ 815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:03.100231 (+ 3711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:03.100236 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:03.100240 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:03.100900 (+ 660us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:03.101287 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:03.101299 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:03.101303 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:03.101434 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:03.101963 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:03.101968 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:03.102184 (+ 216us) client_negotiation.cc:769] Sending connection context
0809 06:52:03.102337 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 06:52:03.102685 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":402,"threads_started":1}
I20260809 06:52:03.105115 12612 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:45057
I20260809 06:52:03.105144 12754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:45057 every 8 connection(s)
I20260809 06:52:03.106564 12612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:52:03.108786 12755 heartbeater.cc:347] Connected to a master server at 127.10.205.126:38551
I20260809 06:52:03.109033 12755 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:03.109737 12755 heartbeater.cc:511] Master 127.10.205.126:38551 requested a full tablet report, sending...
I20260809 06:52:03.111070 12234 ts_manager.cc:194] Registered new tserver with Master: 161ca27a7b664a08a88f9ab3c5b3a746 (127.10.205.67:45057)
I20260809 06:52:03.111864 12234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:60271
I20260809 06:52:03.112707 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 12612
I20260809 06:52:03.112920 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:52:03.113466 11061 external_mini_cluster.cc:1428] Setting key eefdb13ed61fcd4f820ccaacd7009c29
I20260809 06:52:03.116400 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 06:52:03 dist-test-slave-0b58 krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258323, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 06:52:03 dist-test-slave-0b58 krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258323, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:03.169163 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.154856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36164 (local address 127.10.205.126:38551)
0809 06:52:03.155113 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:03.155120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:03.155332 (+ 212us) server_negotiation.cc:407] Connection header received
0809 06:52:03.155565 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:03.155571 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:03.155643 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:03.155752 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:03.157274 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.158025 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.159329 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.159752 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.159931 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.163871 (+ 3940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:03.163879 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:03.163882 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:03.163915 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:03.166410 (+ 2495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:03.167073 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:03.167079 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:03.167088 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:03.167213 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:03.167621 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:03.167627 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:03.167630 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:03.167923 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:03.168197 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:03.168558 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 06:52:03.168808 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 06:52:03.173333 12234 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36164:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:52:03.180564 12234 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:03.213447 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.194055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37564 (local address 127.10.205.65:35943)
0809 06:52:03.203665 (+ 9610us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:03.203678 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:03.204996 (+ 1318us) server_negotiation.cc:407] Connection header received
0809 06:52:03.205273 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:03.205285 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:03.205543 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:03.205730 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:03.206747 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.207862 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.210964 (+ 3102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.212057 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.212207 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.212456 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:03.212935 (+ 479us) server_negotiation.cc:299] Negotiation successful
0809 06:52:03.213111 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9384,"thread_start_us":9215,"threads_started":1}
I20260809 06:52:03.213440 12770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.192896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:35943 (local address 127.0.0.1:37564)
0809 06:52:03.204819 (+ 11923us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:03.204844 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:03.205046 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:03.205942 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:03.205947 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:03.205976 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:03.206518 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.206557 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.208010 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.208016 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.210762 (+ 2746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.210778 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.212304 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.212312 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.212507 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.212595 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 06:52:03.212737 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 06:52:03.212957 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11721,"mutex_wait_us":28,"thread_start_us":11502,"threads_started":1}
I20260809 06:52:03.213564 12768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.193331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:45057 (local address 127.0.0.1:58810)
0809 06:52:03.205410 (+ 12079us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:03.205433 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:03.205548 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:03.206166 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:03.206172 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:03.206205 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:03.206784 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.206807 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.208750 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.208755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.210875 (+ 2120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.210912 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.212709 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.212716 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.212923 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.212956 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 06:52:03.213040 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 06:52:03.213169 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11965,"mutex_wait_us":27,"thread_start_us":8751,"threads_started":1}
I20260809 06:52:03.214125 12769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.192896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60096 (local address 127.10.205.66:43183)
0809 06:52:03.205021 (+ 12125us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:03.205030 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:03.205059 (+ 29us) server_negotiation.cc:407] Connection header received
0809 06:52:03.205179 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:03.205189 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:03.205470 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:03.205692 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:03.206624 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.208195 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.210957 (+ 2762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.212381 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.212515 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.212727 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:03.213658 (+ 931us) server_negotiation.cc:299] Negotiation successful
0809 06:52:03.213825 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11970,"thread_start_us":11840,"threads_started":1}
I20260809 06:52:03.214241 12773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.194592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58810 (local address 127.10.205.67:45057)
0809 06:52:03.204364 (+ 9772us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:03.204372 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:03.205610 (+ 1238us) server_negotiation.cc:407] Connection header received
0809 06:52:03.205729 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:03.205736 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:03.205940 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:03.206165 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:03.207027 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.208602 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.211085 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.212501 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.212611 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.212797 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:03.213705 (+ 908us) server_negotiation.cc:299] Negotiation successful
0809 06:52:03.213866 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9556,"thread_start_us":9331,"threads_started":1}
I20260809 06:52:03.214576 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.192722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:43183 (local address 127.0.0.1:60096)
0809 06:52:03.202641 (+ 9919us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:03.202707 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:03.202940 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:03.205723 (+ 2783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:03.205731 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:03.205761 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:03.206375 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.206398 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.208361 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.208367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.210717 (+ 2350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.210734 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.212919 (+ 2185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.212926 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.213096 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.213127 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 06:52:03.213218 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 06:52:03.213370 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9527,"mutex_wait_us":84,"thread_start_us":12615,"threads_started":1}
I20260809 06:52:03.217829 12381 tablet_service.cc:1467] Processing CreateTablet for tablet 99d1110757744ddda2223e11f05c75a4 (DEFAULT_TABLE table=test-table [id=edc4591d9a634fcd85e21d057a85c3e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:03.217859 12530 tablet_service.cc:1467] Processing CreateTablet for tablet 99d1110757744ddda2223e11f05c75a4 (DEFAULT_TABLE table=test-table [id=edc4591d9a634fcd85e21d057a85c3e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:03.217855 12681 tablet_service.cc:1467] Processing CreateTablet for tablet 99d1110757744ddda2223e11f05c75a4 (DEFAULT_TABLE table=test-table [id=edc4591d9a634fcd85e21d057a85c3e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:03.219067 12381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99d1110757744ddda2223e11f05c75a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:03.219205 12681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99d1110757744ddda2223e11f05c75a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:03.219200 12530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99d1110757744ddda2223e11f05c75a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:03.230983 12774 tablet_bootstrap.cc:492] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825: Bootstrap starting.
I20260809 06:52:03.233747 12775 tablet_bootstrap.cc:492] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f: Bootstrap starting.
I20260809 06:52:03.235442 12776 tablet_bootstrap.cc:492] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746: Bootstrap starting.
I20260809 06:52:03.236115 12774 tablet_bootstrap.cc:654] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:03.237372 12775 tablet_bootstrap.cc:654] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:03.237548 12774 log.cc:824] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:03.238536 12776 tablet_bootstrap.cc:654] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:03.238696 12775 log.cc:824] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:03.239687 12776 log.cc:824] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:03.241710 12774 tablet_bootstrap.cc:492] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825: No bootstrap required, opened a new log
I20260809 06:52:03.242070 12774 ts_tablet_manager.cc:1397] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260809 06:52:03.242276 12776 tablet_bootstrap.cc:492] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746: No bootstrap required, opened a new log
I20260809 06:52:03.242540 12776 ts_tablet_manager.cc:1397] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 06:52:03.246923 12775 tablet_bootstrap.cc:492] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f: No bootstrap required, opened a new log
I20260809 06:52:03.247205 12775 ts_tablet_manager.cc:1397] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260809 06:52:03.250743 12776 raft_consensus.cc:348] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.251216 12776 raft_consensus.cc:374] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:03.251329 12776 raft_consensus.cc:729] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ca27a7b664a08a88f9ab3c5b3a746, State: Initialized, Role: FOLLOWER
I20260809 06:52:03.251971 12776 consensus_queue.cc:260] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.255050 12774 raft_consensus.cc:348] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.255663 12774 raft_consensus.cc:374] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:03.255788 12774 raft_consensus.cc:729] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e560c856b3946019a325f733689a825, State: Initialized, Role: FOLLOWER
I20260809 06:52:03.256239 12775 raft_consensus.cc:348] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.256709 12775 raft_consensus.cc:374] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:03.256819 12775 raft_consensus.cc:729] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 276ad2a2f2174bceb043ebc5154cb12f, State: Initialized, Role: FOLLOWER
I20260809 06:52:03.256664 12774 consensus_queue.cc:260] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.257483 12775 consensus_queue.cc:260] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.258853 12774 ts_tablet_manager.cc:1428] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825: Time spent starting tablet: real 0.017s user 0.016s sys 0.000s
I20260809 06:52:03.259837 12608 heartbeater.cc:503] Master 127.10.205.126:38551 was elected leader, sending a full tablet report...
I20260809 06:52:03.260126 12776 ts_tablet_manager.cc:1428] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746: Time spent starting tablet: real 0.017s user 0.014s sys 0.004s
I20260809 06:52:03.260452 12775 ts_tablet_manager.cc:1428] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f: Time spent starting tablet: real 0.013s user 0.006s sys 0.009s
I20260809 06:52:03.260493 12755 heartbeater.cc:503] Master 127.10.205.126:38551 was elected leader, sending a full tablet report...
W20260809 06:52:03.275031 12458 tablet.cc:2369] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:52:03.312529 12609 tablet.cc:2369] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:52:03.358512 12756 tablet.cc:2369] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:52:03.425359 12782 raft_consensus.cc:482] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:03.425761 12782 raft_consensus.cc:504] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.427601 12782 leader_election.cc:288] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e560c856b3946019a325f733689a825 (127.10.205.65:35943), 161ca27a7b664a08a88f9ab3c5b3a746 (127.10.205.67:45057)
I20260809 06:52:03.437664 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.428252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:35079 (local address 127.10.205.65:35943)
0809 06:52:03.428473 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:03.428480 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:03.429544 (+ 1064us) server_negotiation.cc:407] Connection header received
0809 06:52:03.429901 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:03.429909 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:03.429993 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:03.430088 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:03.430824 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.431960 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.435123 (+ 3163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.436409 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.436579 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.436663 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:03.437249 (+ 586us) server_negotiation.cc:299] Negotiation successful
0809 06:52:03.437381 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:52:03.437654 12773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.428119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:36589 (local address 127.10.205.67:45057)
0809 06:52:03.428401 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:03.428408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:03.429684 (+ 1276us) server_negotiation.cc:407] Connection header received
0809 06:52:03.429971 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:03.429977 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:03.430047 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:03.430152 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:03.431015 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.432059 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.435118 (+ 3059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.436425 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.436580 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.436658 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:03.437249 (+ 591us) server_negotiation.cc:299] Negotiation successful
0809 06:52:03.437381 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260809 06:52:03.437971 12784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.428041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:45057 (local address 127.10.205.66:36589)
0809 06:52:03.429592 (+ 1551us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:03.429608 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:03.429788 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:03.430289 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:03.430294 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:03.430342 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:03.430856 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.430867 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.432199 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.432206 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.434917 (+ 2711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.434934 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.436736 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.436741 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.436974 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.437100 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 06:52:03.437201 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 06:52:03.437458 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1368,"mutex_wait_us":240,"thread_start_us":1361,"threads_started":1}
I20260809 06:52:03.437999 12783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.427966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:35943 (local address 127.10.205.66:35079)
0809 06:52:03.429430 (+ 1464us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:03.429452 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:03.429695 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:03.430124 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:03.430131 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:03.430160 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:03.430641 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.430671 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.432094 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.432098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.434918 (+ 2820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.434933 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.436732 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.436739 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.436975 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.437105 (+ 130us) client_negotiation.cc:769] Sending connection context
0809 06:52:03.437201 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 06:52:03.437458 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1307,"mutex_wait_us":324,"spinlock_wait_cycles":23296,"thread_start_us":1046,"threads_started":1}
I20260809 06:52:03.439167 12702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99d1110757744ddda2223e11f05c75a4" candidate_uuid: "276ad2a2f2174bceb043ebc5154cb12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" is_pre_election: true
I20260809 06:52:03.439157 12403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99d1110757744ddda2223e11f05c75a4" candidate_uuid: "276ad2a2f2174bceb043ebc5154cb12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e560c856b3946019a325f733689a825" is_pre_election: true
I20260809 06:52:03.439733 12702 raft_consensus.cc:2454] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276ad2a2f2174bceb043ebc5154cb12f in term 0.
I20260809 06:52:03.439759 12403 raft_consensus.cc:2454] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276ad2a2f2174bceb043ebc5154cb12f in term 0.
I20260809 06:52:03.440511 12481 leader_election.cc:302] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 161ca27a7b664a08a88f9ab3c5b3a746, 276ad2a2f2174bceb043ebc5154cb12f, 7e560c856b3946019a325f733689a825; no voters:
I20260809 06:52:03.440975 12782 raft_consensus.cc:2781] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:03.441138 12782 raft_consensus.cc:482] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:03.441267 12782 raft_consensus.cc:3037] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:03.443517 12782 raft_consensus.cc:504] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.444192 12782 leader_election.cc:288] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [CANDIDATE]: Term 1 election: Requested vote from peers 7e560c856b3946019a325f733689a825 (127.10.205.65:35943), 161ca27a7b664a08a88f9ab3c5b3a746 (127.10.205.67:45057)
I20260809 06:52:03.444774 12403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99d1110757744ddda2223e11f05c75a4" candidate_uuid: "276ad2a2f2174bceb043ebc5154cb12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e560c856b3946019a325f733689a825"
I20260809 06:52:03.444798 12702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99d1110757744ddda2223e11f05c75a4" candidate_uuid: "276ad2a2f2174bceb043ebc5154cb12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ca27a7b664a08a88f9ab3c5b3a746"
I20260809 06:52:03.445001 12403 raft_consensus.cc:3037] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:03.445022 12702 raft_consensus.cc:3037] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:03.447424 12403 raft_consensus.cc:2454] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 276ad2a2f2174bceb043ebc5154cb12f in term 1.
I20260809 06:52:03.447511 12702 raft_consensus.cc:2454] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 276ad2a2f2174bceb043ebc5154cb12f in term 1.
I20260809 06:52:03.447971 12481 leader_election.cc:302] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 276ad2a2f2174bceb043ebc5154cb12f, 7e560c856b3946019a325f733689a825; no voters:
I20260809 06:52:03.448381 12782 raft_consensus.cc:2781] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:03.448889 12782 raft_consensus.cc:686] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 1 LEADER]: Becoming Leader. State: Replica: 276ad2a2f2174bceb043ebc5154cb12f, State: Running, Role: LEADER
I20260809 06:52:03.449431 12782 consensus_queue.cc:237] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.454718 12234 catalog_manager.cc:5495] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f reported cstate change: term changed from 0 to 1, leader changed from <none> to 276ad2a2f2174bceb043ebc5154cb12f (127.10.205.66). New cstate: current_term: 1 leader_uuid: "276ad2a2f2174bceb043ebc5154cb12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } health_report { overall_health: UNKNOWN } } }
I20260809 06:52:03.504805 12769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.499490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60100 (local address 127.10.205.66:43183)
0809 06:52:03.499674 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:03.499680 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:03.499703 (+ 23us) server_negotiation.cc:407] Connection header received
0809 06:52:03.499964 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:03.499968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:03.500048 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:03.500169 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:03.500567 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.501369 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.502644 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.503028 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.503115 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.503609 (+ 494us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:03.504170 (+ 561us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:03.504346 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:03.504444 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 06:52:03.504511 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 06:52:03.512609 12702 raft_consensus.cc:1261] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 1 FOLLOWER]: Refusing update from remote peer 276ad2a2f2174bceb043ebc5154cb12f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:03.512639 12403 raft_consensus.cc:1261] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825 [term 1 FOLLOWER]: Refusing update from remote peer 276ad2a2f2174bceb043ebc5154cb12f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:03.513514 12785 consensus_queue.cc:1035] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:03.513857 12782 consensus_queue.cc:1035] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:03.550877 12234 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:03.551179 12234 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:03.555145 12234 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92: Sending DeleteTablet for 3 replicas of tablet 99d1110757744ddda2223e11f05c75a4
I20260809 06:52:03.556372 12530 tablet_service.cc:1514] Processing DeleteTablet for tablet 99d1110757744ddda2223e11f05c75a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:03 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:60096
I20260809 06:52:03.556538 12381 tablet_service.cc:1514] Processing DeleteTablet for tablet 99d1110757744ddda2223e11f05c75a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:03 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:37564
I20260809 06:52:03.557564 12681 tablet_service.cc:1514] Processing DeleteTablet for tablet 99d1110757744ddda2223e11f05c75a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:03 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:58810
I20260809 06:52:03.557794 12234 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36164:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:52:03.558521 12234 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:03.567369 12380 tablet_service.cc:1467] Processing CreateTablet for tablet 8fe603fce5494360a92c025433b39a4a (DEFAULT_TABLE table=test-table [id=1f7187c7ddb84fa588eb7698e43cc9b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:03.567553 12680 tablet_service.cc:1467] Processing CreateTablet for tablet 8fe603fce5494360a92c025433b39a4a (DEFAULT_TABLE table=test-table [id=1f7187c7ddb84fa588eb7698e43cc9b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:03.568035 12380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fe603fce5494360a92c025433b39a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:03.568140 12680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fe603fce5494360a92c025433b39a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:03.570600 12529 tablet_service.cc:1467] Processing CreateTablet for tablet 8fe603fce5494360a92c025433b39a4a (DEFAULT_TABLE table=test-table [id=1f7187c7ddb84fa588eb7698e43cc9b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:03.571103 12529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fe603fce5494360a92c025433b39a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:03.575598 12774 tablet_bootstrap.cc:492] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825: Bootstrap starting.
I20260809 06:52:03.577347 12774 tablet_bootstrap.cc:654] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:03.578887 12797 tablet_replica.cc:330] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f: stopping tablet replica
I20260809 06:52:03.579469 12797 raft_consensus.cc:2229] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:03.580315 12797 raft_consensus.cc:2258] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:03.586177 12775 tablet_bootstrap.cc:492] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f: Bootstrap starting.
I20260809 06:52:03.588244 12775 tablet_bootstrap.cc:654] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:03.588807 12776 tablet_bootstrap.cc:492] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746: Bootstrap starting.
I20260809 06:52:03.590565 12776 tablet_bootstrap.cc:654] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:03.596626 12799 tablet_replica.cc:330] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746: stopping tablet replica
I20260809 06:52:03.597316 12799 raft_consensus.cc:2229] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:03.597976 12799 raft_consensus.cc:2258] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:03.600306 12776 tablet_bootstrap.cc:492] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746: No bootstrap required, opened a new log
I20260809 06:52:03.600466 12776 ts_tablet_manager.cc:1397] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.005s
I20260809 06:52:03.601313 12776 raft_consensus.cc:348] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.601560 12776 raft_consensus.cc:374] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:03.601655 12776 raft_consensus.cc:729] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ca27a7b664a08a88f9ab3c5b3a746, State: Initialized, Role: FOLLOWER
I20260809 06:52:03.601821 12774 tablet_bootstrap.cc:492] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825: No bootstrap required, opened a new log
I20260809 06:52:03.601992 12774 ts_tablet_manager.cc:1397] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.007s
I20260809 06:52:03.601960 12776 consensus_queue.cc:260] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.602326 12797 ts_tablet_manager.cc:1905] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:03.602831 12774 raft_consensus.cc:348] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.603076 12774 raft_consensus.cc:374] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:03.603179 12774 raft_consensus.cc:729] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e560c856b3946019a325f733689a825, State: Initialized, Role: FOLLOWER
I20260809 06:52:03.603462 12774 consensus_queue.cc:260] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.604287 12798 tablet_replica.cc:330] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825: stopping tablet replica
I20260809 06:52:03.605072 12776 ts_tablet_manager.cc:1428] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260809 06:52:03.605578 12798 raft_consensus.cc:2229] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:03.608492 12798 raft_consensus.cc:2258] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:03.606431 12774 ts_tablet_manager.cc:1428] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260809 06:52:03.610972 12799 ts_tablet_manager.cc:1905] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:03.615624 12797 ts_tablet_manager.cc:1918] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:03.615682 12799 ts_tablet_manager.cc:1918] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:03.615805 12797 log.cc:1196] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/99d1110757744ddda2223e11f05c75a4
I20260809 06:52:03.615880 12799 log.cc:1196] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/99d1110757744ddda2223e11f05c75a4
I20260809 06:52:03.616438 12797 ts_tablet_manager.cc:1939] T 99d1110757744ddda2223e11f05c75a4 P 276ad2a2f2174bceb043ebc5154cb12f: Deleting consensus metadata
I20260809 06:52:03.616457 12799 ts_tablet_manager.cc:1939] T 99d1110757744ddda2223e11f05c75a4 P 161ca27a7b664a08a88f9ab3c5b3a746: Deleting consensus metadata
I20260809 06:52:03.617950 12775 tablet_bootstrap.cc:492] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f: No bootstrap required, opened a new log
I20260809 06:52:03.618114 12775 ts_tablet_manager.cc:1397] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f: Time spent bootstrapping tablet: real 0.032s user 0.010s sys 0.002s
I20260809 06:52:03.618394 12220 catalog_manager.cc:4841] TS 276ad2a2f2174bceb043ebc5154cb12f (127.10.205.66:43183): tablet 99d1110757744ddda2223e11f05c75a4 (table test-table [id=edc4591d9a634fcd85e21d057a85c3e6]) successfully deleted
I20260809 06:52:03.619131 12221 catalog_manager.cc:4841] TS 161ca27a7b664a08a88f9ab3c5b3a746 (127.10.205.67:45057): tablet 99d1110757744ddda2223e11f05c75a4 (table test-table [id=edc4591d9a634fcd85e21d057a85c3e6]) successfully deleted
I20260809 06:52:03.619062 12775 raft_consensus.cc:348] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.619273 12775 raft_consensus.cc:374] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:03.619372 12775 raft_consensus.cc:729] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 276ad2a2f2174bceb043ebc5154cb12f, State: Initialized, Role: FOLLOWER
I20260809 06:52:03.619652 12775 consensus_queue.cc:260] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.620373 12775 ts_tablet_manager.cc:1428] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260809 06:52:03.611019 12798 ts_tablet_manager.cc:1905] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:03.627869 12798 ts_tablet_manager.cc:1918] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:03.628047 12798 log.cc:1196] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/99d1110757744ddda2223e11f05c75a4
I20260809 06:52:03.628643 12798 ts_tablet_manager.cc:1939] T 99d1110757744ddda2223e11f05c75a4 P 7e560c856b3946019a325f733689a825: Deleting consensus metadata
I20260809 06:52:03.630529 12222 catalog_manager.cc:4841] TS 7e560c856b3946019a325f733689a825 (127.10.205.65:35943): tablet 99d1110757744ddda2223e11f05c75a4 (table test-table [id=edc4591d9a634fcd85e21d057a85c3e6]) successfully deleted
I20260809 06:52:03.708623 12781 raft_consensus.cc:482] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:03.708879 12781 raft_consensus.cc:504] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.710726 12781 leader_election.cc:288] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 276ad2a2f2174bceb043ebc5154cb12f (127.10.205.66:43183), 161ca27a7b664a08a88f9ab3c5b3a746 (127.10.205.67:45057)
I20260809 06:52:03.718909 12773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.711155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:42145 (local address 127.10.205.67:45057)
0809 06:52:03.711360 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:03.711368 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:03.711979 (+ 611us) server_negotiation.cc:407] Connection header received
0809 06:52:03.712341 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:03.712349 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:03.712447 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:03.712544 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:03.713168 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.714305 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.716680 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.717802 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.717956 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.718049 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:03.718468 (+ 419us) server_negotiation.cc:299] Negotiation successful
0809 06:52:03.718618 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 06:52:03.719208 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.711196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:45057 (local address 127.10.205.65:42145)
0809 06:52:03.711853 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:03.711874 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:03.712105 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:03.712555 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:03.712559 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:03.712582 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:03.712993 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.713005 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.714501 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.714506 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.716510 (+ 2004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.716529 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.718026 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.718034 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.718279 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.718315 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:52:03.718421 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 06:52:03.718555 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"mutex_wait_us":61,"thread_start_us":332,"threads_started":1}
I20260809 06:52:03.719821 12805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.711245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:43183 (local address 127.10.205.65:53369)
0809 06:52:03.712180 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:03.712198 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:03.712393 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:03.712834 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:03.712839 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:03.712868 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:03.713296 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.713310 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.714786 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.714798 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.717116 (+ 2318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.717132 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.718856 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.718862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.719063 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.719101 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 06:52:03.719272 (+ 171us) client_negotiation.cc:240] Negotiation successful
0809 06:52:03.719403 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":786,"thread_start_us":684,"threads_started":1}
I20260809 06:52:03.719910 12769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.711673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:53369 (local address 127.10.205.66:43183)
0809 06:52:03.711866 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:03.711872 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:03.712301 (+ 429us) server_negotiation.cc:407] Connection header received
0809 06:52:03.712535 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:03.712541 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:03.712676 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:03.712776 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:03.713487 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.714618 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.717303 (+ 2685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.718464 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.718610 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.718688 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:03.719299 (+ 611us) server_negotiation.cc:299] Negotiation successful
0809 06:52:03.719432 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:52:03.720117 12702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe603fce5494360a92c025433b39a4a" candidate_uuid: "7e560c856b3946019a325f733689a825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" is_pre_election: true
I20260809 06:52:03.720448 12702 raft_consensus.cc:2454] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e560c856b3946019a325f733689a825 in term 0.
I20260809 06:52:03.721026 12331 leader_election.cc:302] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ca27a7b664a08a88f9ab3c5b3a746, 7e560c856b3946019a325f733689a825; no voters:
I20260809 06:52:03.721464 12781 raft_consensus.cc:2781] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:03.721601 12781 raft_consensus.cc:482] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:03.721685 12781 raft_consensus.cc:3037] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:03.721573 12556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe603fce5494360a92c025433b39a4a" candidate_uuid: "7e560c856b3946019a325f733689a825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "276ad2a2f2174bceb043ebc5154cb12f" is_pre_election: true
I20260809 06:52:03.721992 12556 raft_consensus.cc:2454] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e560c856b3946019a325f733689a825 in term 0.
I20260809 06:52:03.725034 12781 raft_consensus.cc:504] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.725751 12781 leader_election.cc:288] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [CANDIDATE]: Term 1 election: Requested vote from peers 276ad2a2f2174bceb043ebc5154cb12f (127.10.205.66:43183), 161ca27a7b664a08a88f9ab3c5b3a746 (127.10.205.67:45057)
I20260809 06:52:03.726255 12556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe603fce5494360a92c025433b39a4a" candidate_uuid: "7e560c856b3946019a325f733689a825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "276ad2a2f2174bceb043ebc5154cb12f"
I20260809 06:52:03.726472 12556 raft_consensus.cc:3037] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:03.726408 12702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe603fce5494360a92c025433b39a4a" candidate_uuid: "7e560c856b3946019a325f733689a825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ca27a7b664a08a88f9ab3c5b3a746"
I20260809 06:52:03.726641 12702 raft_consensus.cc:3037] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:03.729218 12702 raft_consensus.cc:2454] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e560c856b3946019a325f733689a825 in term 1.
I20260809 06:52:03.729624 12331 leader_election.cc:302] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ca27a7b664a08a88f9ab3c5b3a746, 7e560c856b3946019a325f733689a825; no voters:
I20260809 06:52:03.729928 12781 raft_consensus.cc:2781] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:03.729913 12556 raft_consensus.cc:2454] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e560c856b3946019a325f733689a825 in term 1.
I20260809 06:52:03.730549 12781 raft_consensus.cc:686] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 1 LEADER]: Becoming Leader. State: Replica: 7e560c856b3946019a325f733689a825, State: Running, Role: LEADER
I20260809 06:52:03.730979 12781 consensus_queue.cc:237] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.734586 12234 catalog_manager.cc:5495] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e560c856b3946019a325f733689a825 (127.10.205.65). New cstate: current_term: 1 leader_uuid: "7e560c856b3946019a325f733689a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } health_report { overall_health: UNKNOWN } } }
Aug 09 06:52:03 dist-test-slave-0b58 krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258321, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:03.806584 12813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.790774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:38551 (local address 127.0.0.1:36168)
0809 06:52:03.791517 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:03.791544 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:03.791717 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:03.792296 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:03.792301 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:03.793216 (+ 915us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:03.793498 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.793513 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.794585 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.794591 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.796115 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:03.796133 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.796964 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.796970 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:03.797157 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.797906 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:03.797930 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:03.800698 (+ 2768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:03.803696 (+ 2998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:03.803711 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:03.803719 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:03.804345 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:03.804703 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:03.804709 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:03.804713 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:03.804855 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:03.805435 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:03.805443 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:03.805615 (+ 172us) client_negotiation.cc:769] Sending connection context
0809 06:52:03.805786 (+ 171us) client_negotiation.cc:240] Negotiation successful
0809 06:52:03.806090 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":372,"threads_started":1}
I20260809 06:52:03.806582 12814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:03.790803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36168 (local address 127.10.205.126:38551)
0809 06:52:03.791961 (+ 1158us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:03.791965 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:03.791985 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:52:03.792029 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:03.792033 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:03.792087 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:03.792179 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:03.793664 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.794432 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.796349 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:03.796761 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:03.796868 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:03.800901 (+ 4033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:03.800906 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:03.800909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:03.800937 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:03.803563 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:03.804462 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:03.804470 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:03.804476 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:03.804598 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:03.805006 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:03.805015 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:03.805018 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:03.805308 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:03.805460 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:03.805873 (+ 413us) server_negotiation.cc:299] Negotiation successful
0809 06:52:03.806227 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":151,"server-negotiator.queue_time_us":1056,"thread_start_us":924,"threads_started":1}
I20260809 06:52:03.812161 12234 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:36168:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 06:52:03.813309 12234 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:03.820531 12381 tablet_service.cc:1467] Processing CreateTablet for tablet 112b44cfa1b34f64816b6713a60b0980 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=955b192c28c04247b96cd631a7b33fb4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:52:03.820652 12529 tablet_service.cc:1467] Processing CreateTablet for tablet 112b44cfa1b34f64816b6713a60b0980 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=955b192c28c04247b96cd631a7b33fb4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:52:03.821199 12529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 112b44cfa1b34f64816b6713a60b0980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:03.821195 12381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 112b44cfa1b34f64816b6713a60b0980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:03.821056 12680 tablet_service.cc:1467] Processing CreateTablet for tablet 112b44cfa1b34f64816b6713a60b0980 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=955b192c28c04247b96cd631a7b33fb4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:52:03.821611 12680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 112b44cfa1b34f64816b6713a60b0980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:03.829113 12774 tablet_bootstrap.cc:492] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825: Bootstrap starting.
I20260809 06:52:03.829252 12775 tablet_bootstrap.cc:492] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: Bootstrap starting.
I20260809 06:52:03.829291 12776 tablet_bootstrap.cc:492] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746: Bootstrap starting.
I20260809 06:52:03.830935 12774 tablet_bootstrap.cc:654] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:03.830947 12775 tablet_bootstrap.cc:654] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:03.830998 12776 tablet_bootstrap.cc:654] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:03.840888 12775 tablet_bootstrap.cc:492] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: No bootstrap required, opened a new log
I20260809 06:52:03.841082 12775 ts_tablet_manager.cc:1397] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.008s
I20260809 06:52:03.841418 12774 tablet_bootstrap.cc:492] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825: No bootstrap required, opened a new log
I20260809 06:52:03.841595 12774 ts_tablet_manager.cc:1397] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.008s
I20260809 06:52:03.841974 12775 raft_consensus.cc:348] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.842245 12775 raft_consensus.cc:374] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:03.842204 12774 raft_consensus.cc:348] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.842346 12775 raft_consensus.cc:729] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 276ad2a2f2174bceb043ebc5154cb12f, State: Initialized, Role: FOLLOWER
I20260809 06:52:03.842460 12774 raft_consensus.cc:374] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:03.842543 12774 raft_consensus.cc:729] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e560c856b3946019a325f733689a825, State: Initialized, Role: FOLLOWER
I20260809 06:52:03.842794 12774 consensus_queue.cc:260] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.843176 12776 tablet_bootstrap.cc:492] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746: No bootstrap required, opened a new log
I20260809 06:52:03.843358 12776 ts_tablet_manager.cc:1397] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.006s
I20260809 06:52:03.843441 12774 ts_tablet_manager.cc:1428] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 06:52:03.843291 12781 tablet_replica.cc:439] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } } }
I20260809 06:52:03.843600 12781 tablet_replica.cc:442] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:03.844143 12776 raft_consensus.cc:348] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.844419 12776 raft_consensus.cc:374] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:03.844511 12776 raft_consensus.cc:729] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ca27a7b664a08a88f9ab3c5b3a746, State: Initialized, Role: FOLLOWER
I20260809 06:52:03.844852 12775 consensus_queue.cc:260] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.845363 12782 tablet_replica.cc:439] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } } }
I20260809 06:52:03.845641 12782 tablet_replica.cc:442] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:03.846158 12775 ts_tablet_manager.cc:1428] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260809 06:52:03.846732 12776 consensus_queue.cc:260] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.847257 12780 tablet_replica.cc:439] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } } }
I20260809 06:52:03.847643 12780 tablet_replica.cc:442] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:03.848384 12776 ts_tablet_manager.cc:1428] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260809 06:52:03.974233 12782 raft_consensus.cc:482] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:03.974507 12782 raft_consensus.cc:504] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.975251 12782 leader_election.cc:288] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e560c856b3946019a325f733689a825 (127.10.205.65:35943), 161ca27a7b664a08a88f9ab3c5b3a746 (127.10.205.67:45057)
I20260809 06:52:03.975893 12702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "112b44cfa1b34f64816b6713a60b0980" candidate_uuid: "276ad2a2f2174bceb043ebc5154cb12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" is_pre_election: true
I20260809 06:52:03.975903 12403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "112b44cfa1b34f64816b6713a60b0980" candidate_uuid: "276ad2a2f2174bceb043ebc5154cb12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e560c856b3946019a325f733689a825" is_pre_election: true
I20260809 06:52:03.976173 12403 raft_consensus.cc:2454] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276ad2a2f2174bceb043ebc5154cb12f in term 0.
I20260809 06:52:03.976191 12702 raft_consensus.cc:2454] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276ad2a2f2174bceb043ebc5154cb12f in term 0.
I20260809 06:52:03.976748 12481 leader_election.cc:302] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 276ad2a2f2174bceb043ebc5154cb12f, 7e560c856b3946019a325f733689a825; no voters:
I20260809 06:52:03.977070 12782 raft_consensus.cc:2781] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:03.977237 12782 raft_consensus.cc:482] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:03.977409 12782 raft_consensus.cc:3037] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:03.979619 12782 raft_consensus.cc:504] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.980230 12782 leader_election.cc:288] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [CANDIDATE]: Term 1 election: Requested vote from peers 7e560c856b3946019a325f733689a825 (127.10.205.65:35943), 161ca27a7b664a08a88f9ab3c5b3a746 (127.10.205.67:45057)
I20260809 06:52:03.980830 12403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "112b44cfa1b34f64816b6713a60b0980" candidate_uuid: "276ad2a2f2174bceb043ebc5154cb12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e560c856b3946019a325f733689a825"
I20260809 06:52:03.980824 12702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "112b44cfa1b34f64816b6713a60b0980" candidate_uuid: "276ad2a2f2174bceb043ebc5154cb12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ca27a7b664a08a88f9ab3c5b3a746"
I20260809 06:52:03.981066 12403 raft_consensus.cc:3037] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:03.981077 12702 raft_consensus.cc:3037] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:03.983361 12403 raft_consensus.cc:2454] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 276ad2a2f2174bceb043ebc5154cb12f in term 1.
I20260809 06:52:03.984108 12702 raft_consensus.cc:2454] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 276ad2a2f2174bceb043ebc5154cb12f in term 1.
I20260809 06:52:03.984623 12479 leader_election.cc:302] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ca27a7b664a08a88f9ab3c5b3a746, 276ad2a2f2174bceb043ebc5154cb12f; no voters:
I20260809 06:52:03.984997 12782 raft_consensus.cc:2781] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:03.985204 12782 raft_consensus.cc:686] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [term 1 LEADER]: Becoming Leader. State: Replica: 276ad2a2f2174bceb043ebc5154cb12f, State: Running, Role: LEADER
I20260809 06:52:03.985526 12782 consensus_queue.cc:237] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } }
I20260809 06:52:03.987385 12785 tablet_replica.cc:439] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: TxnStatusTablet state changed. Reason: New leader 276ad2a2f2174bceb043ebc5154cb12f. Latest consensus state: current_term: 1 leader_uuid: "276ad2a2f2174bceb043ebc5154cb12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } } }
I20260809 06:52:03.987692 12785 tablet_replica.cc:442] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:52:03.988615 12819 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 06:52:03.988927 12819 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 06:52:03.989322 12234 catalog_manager.cc:5495] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f reported cstate change: term changed from 0 to 1, leader changed from <none> to 276ad2a2f2174bceb043ebc5154cb12f (127.10.205.66). New cstate: current_term: 1 leader_uuid: "276ad2a2f2174bceb043ebc5154cb12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } health_report { overall_health: UNKNOWN } } }
I20260809 06:52:04.010524 12769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:04.004319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60114 (local address 127.10.205.66:43183)
0809 06:52:04.004541 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:04.004562 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:04.004833 (+ 271us) server_negotiation.cc:407] Connection header received
0809 06:52:04.005119 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:04.005126 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:04.005234 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:04.005345 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:04.005764 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.006514 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.008497 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.009026 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.009128 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:04.009755 (+ 627us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:04.009857 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:04.009927 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:04.010152 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 06:52:04.010234 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 06:52:04.010601 12813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:04.004296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:43183 (local address 127.0.0.1:60114)
0809 06:52:04.004730 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:04.004750 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:04.004907 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:04.005414 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:04.005419 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:04.005434 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:52:04.005629 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:04.005639 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.006665 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.006671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:04.008339 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:04.008356 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.009188 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.009194 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:04.009445 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:04.009527 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:52:04.009964 (+ 437us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:52:04.009993 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 06:52:04.010106 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 06:52:04.010277 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255}
I20260809 06:52:04.014804 12702 raft_consensus.cc:1261] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746 [term 1 FOLLOWER]: Refusing update from remote peer 276ad2a2f2174bceb043ebc5154cb12f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:04.014922 12403 raft_consensus.cc:1261] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825 [term 1 FOLLOWER]: Refusing update from remote peer 276ad2a2f2174bceb043ebc5154cb12f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:04.015564 12785 consensus_queue.cc:1035] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:04.015851 12782 consensus_queue.cc:1035] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:04.018532 12781 tablet_replica.cc:439] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825: TxnStatusTablet state changed. Reason: New leader 276ad2a2f2174bceb043ebc5154cb12f. Latest consensus state: current_term: 1 leader_uuid: "276ad2a2f2174bceb043ebc5154cb12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } } }
I20260809 06:52:04.018817 12781 tablet_replica.cc:442] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:04.020565 12785 tablet_replica.cc:439] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "276ad2a2f2174bceb043ebc5154cb12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } } }
I20260809 06:52:04.020843 12785 tablet_replica.cc:442] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:52:04.021049 12788 mvcc.cc:205] Tried to move back new op lower bound from 7316514095158177792 to 7316514095047168000. Current Snapshot: MvccSnapshot[applied={T|T < 7316514095158177792}]
I20260809 06:52:04.023243 12789 mvcc.cc:205] Tried to move back new op lower bound from 7316514095158177792 to 7316514095047168000. Current Snapshot: MvccSnapshot[applied={T|T < 7316514095158177792}]
I20260809 06:52:04.024425 12781 tablet_replica.cc:439] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "276ad2a2f2174bceb043ebc5154cb12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } } }
I20260809 06:52:04.024817 12781 tablet_replica.cc:442] T 112b44cfa1b34f64816b6713a60b0980 P 7e560c856b3946019a325f733689a825: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:04.032274 12780 tablet_replica.cc:439] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746: TxnStatusTablet state changed. Reason: New leader 276ad2a2f2174bceb043ebc5154cb12f. Latest consensus state: current_term: 1 leader_uuid: "276ad2a2f2174bceb043ebc5154cb12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } } }
I20260809 06:52:04.032553 12780 tablet_replica.cc:442] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:04.035787 12782 tablet_replica.cc:439] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "276ad2a2f2174bceb043ebc5154cb12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } } }
I20260809 06:52:04.036172 12782 tablet_replica.cc:442] T 112b44cfa1b34f64816b6713a60b0980 P 276ad2a2f2174bceb043ebc5154cb12f: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:52:04.036674 12791 mvcc.cc:205] Tried to move back new op lower bound from 7316514095158177792 to 7316514095047168000. Current Snapshot: MvccSnapshot[applied={T|T < 7316514095158177792}]
I20260809 06:52:04.036983 12780 tablet_replica.cc:439] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "276ad2a2f2174bceb043ebc5154cb12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e560c856b3946019a325f733689a825" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 35943 } } peers { permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 } } peers { permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 } } }
I20260809 06:52:04.037192 12780 tablet_replica.cc:442] T 112b44cfa1b34f64816b6713a60b0980 P 161ca27a7b664a08a88f9ab3c5b3a746: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:04.044293 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:04.031122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37574 (local address 127.10.205.65:35943)
0809 06:52:04.034162 (+ 3040us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:04.034169 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:04.034310 (+ 141us) server_negotiation.cc:407] Connection header received
0809 06:52:04.034523 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:04.034529 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:04.034654 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:04.034831 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:04.039319 (+ 4488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.040408 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.041892 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.042361 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.042497 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:04.042957 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:04.043536 (+ 579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:04.043710 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:04.043768 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 06:52:04.043863 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2916,"thread_start_us":2759,"threads_started":1}
I20260809 06:52:04.061659 12769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:04.055264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:58971 (local address 127.10.205.66:43183)
0809 06:52:04.055459 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:04.055466 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:04.056311 (+ 845us) server_negotiation.cc:407] Connection header received
0809 06:52:04.056560 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:04.056565 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:04.056646 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:04.056744 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:04.057355 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.058191 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.059737 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.060187 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.060384 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:04.060848 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:04.060978 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:04.061089 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:04.061234 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 06:52:04.061317 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:52:04.061766 12829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:04.055365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:43183 (local address 127.10.205.65:58971)
0809 06:52:04.056151 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:04.056168 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:04.056408 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:04.056762 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:04.056767 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:04.056778 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:52:04.057191 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:04.057202 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.058350 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.058355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:04.059574 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:04.059586 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.060430 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.060439 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:04.060590 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:04.060650 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:52:04.061090 (+ 440us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:52:04.061104 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 06:52:04.061207 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 06:52:04.061342 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":438,"threads_started":1}
I20260809 06:52:04.073364 12702 raft_consensus.cc:1261] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746 [term 1 FOLLOWER]: Refusing update from remote peer 7e560c856b3946019a325f733689a825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:04.073642 12556 raft_consensus.cc:1261] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f [term 1 FOLLOWER]: Refusing update from remote peer 7e560c856b3946019a325f733689a825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:04.074008 12806 consensus_queue.cc:1035] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ca27a7b664a08a88f9ab3c5b3a746" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:04.074431 12781 consensus_queue.cc:1035] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "276ad2a2f2174bceb043ebc5154cb12f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 43183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:04.129869 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:04.109812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:59679 (local address 127.10.205.65:35943)
0809 06:52:04.110005 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:04.110011 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:04.121809 (+ 11798us) server_negotiation.cc:407] Connection header received
0809 06:52:04.122380 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:04.122386 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:04.122482 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:04.122553 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:04.123497 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.124651 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.127315 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.127969 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.128068 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:04.129005 (+ 937us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:04.129146 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:04.129213 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:04.129451 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 06:52:04.129551 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:52:04.130775 12836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:04.109421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:35943 (local address 127.10.205.66:59679)
0809 06:52:04.121588 (+ 12167us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:04.121616 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:04.122175 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:04.122789 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:04.122794 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:04.122807 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:52:04.123206 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:04.123219 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.124858 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.124863 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:04.126660 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:04.126678 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.128467 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.128475 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:04.128678 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:04.128766 (+ 88us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:52:04.129302 (+ 536us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:52:04.129321 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 06:52:04.130166 (+ 845us) client_negotiation.cc:240] Negotiation successful
0809 06:52:04.130322 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11914,"thread_start_us":12416,"threads_started":1}
I20260809 06:52:04.172101 12234 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:04.172433 12234 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:04.175967 12234 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb11abe0267149f58349d8290e91ec92: Sending DeleteTablet for 3 replicas of tablet 8fe603fce5494360a92c025433b39a4a
I20260809 06:52:04.177160 12680 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fe603fce5494360a92c025433b39a4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:04 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:58810
I20260809 06:52:04.177201 12381 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fe603fce5494360a92c025433b39a4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:04 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:37564
I20260809 06:52:04.177690 12529 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fe603fce5494360a92c025433b39a4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:04 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:60096
I20260809 06:52:04.186757 12841 tablet_replica.cc:330] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f: stopping tablet replica
I20260809 06:52:04.187788 12841 raft_consensus.cc:2229] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:04.188580 12841 raft_consensus.cc:2258] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:04.190729 12841 ts_tablet_manager.cc:1905] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:04.205839 12840 tablet_replica.cc:330] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825: stopping tablet replica
I20260809 06:52:04.206110 12840 raft_consensus.cc:2229] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:04.206979 12840 raft_consensus.cc:2258] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:04.208470 12839 tablet_replica.cc:330] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746: stopping tablet replica
I20260809 06:52:04.208698 12839 raft_consensus.cc:2229] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:04.208964 12839 raft_consensus.cc:2258] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:04.210547 12841 ts_tablet_manager.cc:1918] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:52:04.210799 12841 log.cc:1196] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/8fe603fce5494360a92c025433b39a4a
I20260809 06:52:04.211603 12841 ts_tablet_manager.cc:1939] T 8fe603fce5494360a92c025433b39a4a P 276ad2a2f2174bceb043ebc5154cb12f: Deleting consensus metadata
I20260809 06:52:04.213055 12220 catalog_manager.cc:4841] TS 276ad2a2f2174bceb043ebc5154cb12f (127.10.205.66:43183): tablet 8fe603fce5494360a92c025433b39a4a (table test-table [id=1f7187c7ddb84fa588eb7698e43cc9b2]) successfully deleted
I20260809 06:52:04.213490 12840 ts_tablet_manager.cc:1905] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:04.217314 12839 ts_tablet_manager.cc:1905] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:04.230999 12839 ts_tablet_manager.cc:1918] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:52:04.231166 12839 log.cc:1196] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/8fe603fce5494360a92c025433b39a4a
I20260809 06:52:04.231637 12839 ts_tablet_manager.cc:1939] T 8fe603fce5494360a92c025433b39a4a P 161ca27a7b664a08a88f9ab3c5b3a746: Deleting consensus metadata
I20260809 06:52:04.232869 12221 catalog_manager.cc:4841] TS 161ca27a7b664a08a88f9ab3c5b3a746 (127.10.205.67:45057): tablet 8fe603fce5494360a92c025433b39a4a (table test-table [id=1f7187c7ddb84fa588eb7698e43cc9b2]) successfully deleted
Aug 09 06:52:04 dist-test-slave-0b58 krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258323, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:52:04.235993 12840 ts_tablet_manager.cc:1918] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:52:04.236248 12840 log.cc:1196] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/8fe603fce5494360a92c025433b39a4a
I20260809 06:52:04.236963 12840 ts_tablet_manager.cc:1939] T 8fe603fce5494360a92c025433b39a4a P 7e560c856b3946019a325f733689a825: Deleting consensus metadata
I20260809 06:52:04.238337 12222 catalog_manager.cc:4841] TS 7e560c856b3946019a325f733689a825 (127.10.205.65:35943): tablet 8fe603fce5494360a92c025433b39a4a (table test-table [id=1f7187c7ddb84fa588eb7698e43cc9b2]) successfully deleted
I20260809 06:52:04.243762 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:04.203635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37580 (local address 127.10.205.65:35943)
0809 06:52:04.203933 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:04.203942 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:04.207992 (+ 4050us) server_negotiation.cc:407] Connection header received
0809 06:52:04.210531 (+ 2539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:04.210538 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:04.210639 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:04.210737 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:04.222492 (+ 11755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.224422 (+ 1930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.230844 (+ 6422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.231556 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.231692 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:04.237108 (+ 5416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:04.237126 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:04.237167 (+ 41us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:04.237231 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:04.240894 (+ 3663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:04.241609 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:04.241616 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:04.241618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:04.241747 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:04.242152 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:04.242156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:04.242158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:04.242543 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:04.242877 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:04.243153 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 06:52:04.243390 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
W20260809 06:52:04.244562 12451 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37580
I20260809 06:52:04.261130 12814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:04.247879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36180 (local address 127.10.205.126:38551)
0809 06:52:04.248125 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:04.248132 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:04.248437 (+ 305us) server_negotiation.cc:407] Connection header received
0809 06:52:04.248625 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:04.248631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:04.248716 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:04.248822 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:04.250081 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.250889 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.252503 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.253035 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.253173 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:04.255479 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:04.255485 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:04.255490 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:04.255532 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:04.258344 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:04.259067 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:04.259074 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:04.259077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:04.259210 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:04.259572 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:04.259577 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:04.259581 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:04.259888 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:04.260183 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:04.260580 (+ 397us) server_negotiation.cc:299] Negotiation successful
0809 06:52:04.260830 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260809 06:52:04.261977 12234 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36180
I20260809 06:52:04.264133 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 12313
I20260809 06:52:04.279157 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:04.265904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37596 (local address 127.10.205.65:35943)
0809 06:52:04.266443 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:04.266449 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:04.266467 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:52:04.266660 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:04.266666 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:04.266761 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:04.266837 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:04.268317 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.269051 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.270254 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.270720 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.270872 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:04.273150 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:04.273155 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:04.273159 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:04.273189 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:04.276132 (+ 2943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:04.276927 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:04.276934 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:04.276938 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:04.277065 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:04.277481 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:04.277486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:04.277489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:04.277860 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:04.278122 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:04.278489 (+ 367us) server_negotiation.cc:299] Negotiation successful
0809 06:52:04.278753 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397}
W20260809 06:52:04.279846 12451 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37596
W20260809 06:52:04.280509 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 12313: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:52:04.280705 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 12313
I20260809 06:52:04.308918 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 12461
Aug 09 06:52:04 dist-test-slave-0b58 krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258323, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:52:04.326875 12769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:04.309763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60118 (local address 127.10.205.66:43183)
0809 06:52:04.309974 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:04.309980 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:04.310002 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:52:04.310229 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:04.310236 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:04.310328 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:04.310438 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:04.311780 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.313001 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.314234 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.314976 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.315109 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:04.319610 (+ 4501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:04.319631 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:04.319652 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:04.319697 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:04.323909 (+ 4212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:04.324656 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:04.324666 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:04.324670 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:04.324833 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:04.325189 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:04.325194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:04.325198 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:04.325696 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:04.326025 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:04.326236 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 06:52:04.326475 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 06:52:04.327770 12602 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60118
W20260809 06:52:04.328610 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 12461: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:52:04.328812 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 12461
I20260809 06:52:04.354702 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 12612
Aug 09 06:52:04 dist-test-slave-0b58 krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258323, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:52:04.370671 12849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:04.355450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58814 (local address 127.10.205.67:45057)
0809 06:52:04.355961 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:04.355965 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:04.355982 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:52:04.356037 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:04.356042 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:04.356111 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:04.356203 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:04.357499 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.358192 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.359390 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:04.360052 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:04.360193 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:04.364655 (+ 4462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:04.364675 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:04.364696 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:04.364736 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:04.367932 (+ 3196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:04.368759 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:04.368767 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:04.368769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:04.368900 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:04.369257 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:04.369261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:04.369262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:04.369593 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:04.369813 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:04.370140 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 06:52:04.370308 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":297,"threads_started":1}
W20260809 06:52:04.371421 12750 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58814
W20260809 06:52:04.372227 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 12612: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:52:04.372521 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 12612
I20260809 06:52:04.392472 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 12202
I20260809 06:52:04.393666 12280 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:04.513553 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 12202
2026-08-09T06:52:04Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4925 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:52:04 dist-test-slave-0b58 krb5kdc[12853](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:52:04 dist-test-slave-0b58 krb5kdc[12853](info): set up 2 sockets
Aug 09 06:52:04 dist-test-slave-0b58 krb5kdc[12853](info): commencing operation
krb5kdc: starting...
W20260809 06:52:05.632807 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.007s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:52:05 dist-test-slave-0b58 krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:52:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:52:05.847601 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:39229
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:39229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:06.176379 12867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:06.176733 12867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:06.176903 12867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:06.184562 12867 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:06.184710 12867 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 06:52:06.184811 12867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:06.184922 12867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:06.185009 12867 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:06.185101 12867 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:06.195473 12867 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:39229
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:39229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:06.197008 12867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:06.198408 12867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:06.210795 12875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:06.210808 12872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:06.210872 12873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:06.211861 12867 server_base.cc:1034] running on GCE node
I20260809 06:52:06.212747 12867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:06.214176 12867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:06.215457 12867 hybrid_clock.cc:648] HybridClock initialized: now 1786258326215390 us; error 37 us; skew 500 ppm
I20260809 06:52:06.215832 12867 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:06 dist-test-slave-0b58 krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258326, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:06.225910 12867 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:52:06.228271 12867 webserver.cc:460] Webserver started at http://127.10.205.126:41905/ using document root <none> and password file <none>
I20260809 06:52:06.229375 12867 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:06.229516 12867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:06.229924 12867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:06.233564 12867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "07b677dc6edb4eb38530c0e9b0bae75b"
format_stamp: "Formatted at 2026-08-09 06:52:06 on dist-test-slave-0b58"
server_key: "c6e6bf97fad608d7848da5742c9cf90e"
server_key_iv: "a39891c63c9b1a1f53c8730eca590e09"
server_key_version: "encryptionkey@0"
I20260809 06:52:06.234334 12867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "07b677dc6edb4eb38530c0e9b0bae75b"
format_stamp: "Formatted at 2026-08-09 06:52:06 on dist-test-slave-0b58"
server_key: "c6e6bf97fad608d7848da5742c9cf90e"
server_key_iv: "a39891c63c9b1a1f53c8730eca590e09"
server_key_version: "encryptionkey@0"
I20260809 06:52:06.239714 12867 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 06:52:06.243244 12882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:06.244658 12867 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:06.244861 12867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "07b677dc6edb4eb38530c0e9b0bae75b"
format_stamp: "Formatted at 2026-08-09 06:52:06 on dist-test-slave-0b58"
server_key: "c6e6bf97fad608d7848da5742c9cf90e"
server_key_iv: "a39891c63c9b1a1f53c8730eca590e09"
server_key_version: "encryptionkey@0"
I20260809 06:52:06.245098 12867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:06.276424 12867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:06.280736 12867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:06.281049 12867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:06.303143 12867 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:39229
I20260809 06:52:06.303151 12945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:39229 every 8 connection(s)
I20260809 06:52:06.304601 12867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:06.308380 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 12867
I20260809 06:52:06.308602 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:06.308656 12946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:06.309294 11061 external_mini_cluster.cc:1428] Setting key eccc95bdd0fc22fdaea78f5e06b6d324
I20260809 06:52:06.323269 12946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b: Bootstrap starting.
Aug 09 06:52:06 dist-test-slave-0b58 krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:06.327256 12946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:06.328722 12946 log.cc:824] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:06.332418 12946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b: No bootstrap required, opened a new log
I20260809 06:52:06.334112 12949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:06.311363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36086 (local address 127.10.205.126:39229)
0809 06:52:06.312296 (+ 933us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:06.312314 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:06.312371 (+ 57us) server_negotiation.cc:407] Connection header received
0809 06:52:06.314037 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:06.314068 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:06.314548 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:06.315016 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:06.316389 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:06.318365 (+ 1976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:06.319734 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:06.320907 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:06.321099 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:06.325171 (+ 4072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:06.325184 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:06.325206 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:06.325257 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:06.329430 (+ 4173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:06.330366 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:06.330378 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:06.330389 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:06.330588 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:06.330945 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:06.330950 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:06.330952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:06.331668 (+ 716us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:06.331984 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:06.332290 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 06:52:06.332737 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":386,"threads_started":1}
I20260809 06:52:06.341033 12946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b677dc6edb4eb38530c0e9b0bae75b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39229 } }
I20260809 06:52:06.341473 12946 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:06.341550 12946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07b677dc6edb4eb38530c0e9b0bae75b, State: Initialized, Role: FOLLOWER
I20260809 06:52:06.342114 12946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b677dc6edb4eb38530c0e9b0bae75b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39229 } }
I20260809 06:52:06.342339 12946 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:06.342439 12946 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:06.342571 12946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:06.344812 12946 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b677dc6edb4eb38530c0e9b0bae75b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39229 } }
I20260809 06:52:06.345264 12946 leader_election.cc:302] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07b677dc6edb4eb38530c0e9b0bae75b; no voters:
I20260809 06:52:06.345857 12946 leader_election.cc:288] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:06.346007 12951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:06.346767 12951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [term 1 LEADER]: Becoming Leader. State: Replica: 07b677dc6edb4eb38530c0e9b0bae75b, State: Running, Role: LEADER
I20260809 06:52:06.347374 12951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b677dc6edb4eb38530c0e9b0bae75b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39229 } }
I20260809 06:52:06.348176 12946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:06.350368 12952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07b677dc6edb4eb38530c0e9b0bae75b. Latest consensus state: current_term: 1 leader_uuid: "07b677dc6edb4eb38530c0e9b0bae75b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b677dc6edb4eb38530c0e9b0bae75b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39229 } } }
I20260809 06:52:06.350342 12953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07b677dc6edb4eb38530c0e9b0bae75b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b677dc6edb4eb38530c0e9b0bae75b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39229 } } }
I20260809 06:52:06.350806 12952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:06.350886 12953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:06.352517 12957 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:06.358067 12957 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:06.366550 12957 catalog_manager.cc:1347] Generated new cluster ID: ef8948aac5554e8abc9ebb3ec2e0ead9
I20260809 06:52:06.366669 12957 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:06.386080 12957 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:06.388044 12957 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:06.401494 12957 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b: Generated new TSK 0
I20260809 06:52:06.402590 12957 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:52:06.466051 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39229
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:06.801964 12972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:06.802258 12972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:06.802364 12972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:06.809974 12972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:06.810091 12972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:06.810177 12972 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 06:52:06.810231 12972 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:52:06.810305 12972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:52:06.820122 12972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.205.126:39229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:06.821461 12972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:06.822758 12972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:06.835996 12978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:06.836050 12980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:06.836836 12972 server_base.cc:1034] running on GCE node
W20260809 06:52:06.836941 12977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:06.837589 12972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:06.838513 12972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:06.839749 12972 hybrid_clock.cc:648] HybridClock initialized: now 1786258326839712 us; error 50 us; skew 500 ppm
I20260809 06:52:06.840071 12972 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:06 dist-test-slave-0b58 krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258326, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:06.843185 12972 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:52:06.844590 12972 webserver.cc:460] Webserver started at http://127.10.205.65:35951/ using document root <none> and password file <none>
I20260809 06:52:06.845216 12972 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:06.845316 12972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:06.845571 12972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:06.848656 12972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "725534b1392246f4a0e87123c504fcaa"
format_stamp: "Formatted at 2026-08-09 06:52:06 on dist-test-slave-0b58"
server_key: "956978688a1859ffbc3fb9cf57519f6b"
server_key_iv: "8efd20dc368eba5a3bec27cc94a86543"
server_key_version: "encryptionkey@0"
I20260809 06:52:06.849534 12972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "725534b1392246f4a0e87123c504fcaa"
format_stamp: "Formatted at 2026-08-09 06:52:06 on dist-test-slave-0b58"
server_key: "956978688a1859ffbc3fb9cf57519f6b"
server_key_iv: "8efd20dc368eba5a3bec27cc94a86543"
server_key_version: "encryptionkey@0"
I20260809 06:52:06.854866 12972 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 06:52:06.858280 12988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:06.859812 12972 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:52:06.859947 12972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "725534b1392246f4a0e87123c504fcaa"
format_stamp: "Formatted at 2026-08-09 06:52:06 on dist-test-slave-0b58"
server_key: "956978688a1859ffbc3fb9cf57519f6b"
server_key_iv: "8efd20dc368eba5a3bec27cc94a86543"
server_key_version: "encryptionkey@0"
I20260809 06:52:06.860126 12972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:06.888826 12972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:06.892742 12972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:06.892990 12972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:06.895516 12972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:06.895608 12972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:06.895780 12972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:06.895882 12972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:52:06 dist-test-slave-0b58 krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258326, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:06.922297 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:06.896381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:34509 (local address 127.10.205.126:39229)
0809 06:52:06.896873 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:06.896880 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:06.898159 (+ 1279us) server_negotiation.cc:407] Connection header received
0809 06:52:06.901664 (+ 3505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:06.901673 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:06.901795 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:06.901937 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:06.904216 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:06.905351 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:06.907892 (+ 2541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:06.908522 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:06.908664 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:06.914251 (+ 5587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:06.914260 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:06.914267 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:06.914317 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:06.918479 (+ 4162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:06.919527 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:06.919536 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:06.919542 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:06.919727 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:06.920350 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:06.920357 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:06.920362 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:06.920714 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:06.920880 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:06.921660 (+ 780us) server_negotiation.cc:299] Negotiation successful
0809 06:52:06.921910 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":248,"threads_started":1}
I20260809 06:52:06.923365 12999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:06.897030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39229 (local address 127.10.205.65:34509)
0809 06:52:06.897964 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:06.898026 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:06.901279 (+ 3253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:06.902236 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:06.902250 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:06.903094 (+ 844us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:06.903937 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:06.903965 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:06.905511 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:06.905517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:06.907710 (+ 2193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:06.907731 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:06.908799 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:06.908808 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:06.909130 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:06.910036 (+ 906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:06.910075 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:06.913874 (+ 3799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:06.918666 (+ 4792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:06.918681 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:06.918704 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:06.919370 (+ 666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:06.919887 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:06.919890 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:06.919893 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:06.920123 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:06.920875 (+ 752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:06.920883 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:06.921259 (+ 376us) client_negotiation.cc:769] Sending connection context
0809 06:52:06.921556 (+ 297us) client_negotiation.cc:240] Negotiation successful
0809 06:52:06.922114 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":365,"threads_started":1}
I20260809 06:52:06.944207 13075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:06.930189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39229 (local address 127.10.205.65:46003)
0809 06:52:06.930805 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:06.930821 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:06.930987 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:06.931333 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:06.931338 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:06.931810 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:06.932098 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:06.932108 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:06.933137 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:06.933154 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:06.934911 (+ 1757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:06.934924 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:06.935933 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:06.935940 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:06.936104 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:06.936837 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:06.936855 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:06.937900 (+ 1045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:06.941268 (+ 3368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:06.941277 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:06.941284 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:06.941966 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:06.942357 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:06.942363 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:06.942367 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:06.942573 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:06.943314 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:06.943319 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:06.943515 (+ 196us) client_negotiation.cc:769] Sending connection context
0809 06:52:06.943631 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 06:52:06.943867 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":340,"threads_started":1}
I20260809 06:52:06.944643 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:06.930063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:46003 (local address 127.10.205.126:39229)
0809 06:52:06.930236 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:06.930240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:06.930918 (+ 678us) server_negotiation.cc:407] Connection header received
0809 06:52:06.931118 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:06.931123 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:06.931199 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:06.931304 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:06.932250 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:06.932983 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:06.935072 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:06.935714 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:06.935852 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:06.938105 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:06.938111 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:06.938123 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:06.938154 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:06.941109 (+ 2955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:06.942094 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:06.942098 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:06.942100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:06.942222 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:06.942715 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:06.942723 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:06.942729 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:06.943163 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:06.943340 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:06.943785 (+ 445us) server_negotiation.cc:299] Negotiation successful
0809 06:52:06.944092 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:52:06.952478 12972 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:43087
I20260809 06:52:06.952560 13112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:43087 every 8 connection(s)
I20260809 06:52:06.953779 12972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:52:06.955966 13113 heartbeater.cc:347] Connected to a master server at 127.10.205.126:39229
I20260809 06:52:06.956207 13113 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:06.956902 13113 heartbeater.cc:511] Master 127.10.205.126:39229 requested a full tablet report, sending...
I20260809 06:52:06.958822 12901 ts_manager.cc:194] Registered new tserver with Master: 725534b1392246f4a0e87123c504fcaa (127.10.205.65:43087)
I20260809 06:52:06.959254 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 12972
I20260809 06:52:06.959455 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:52:06.960090 11061 external_mini_cluster.cc:1428] Setting key bf435242a03273d5961593e57d7bb541
I20260809 06:52:06.960549 12901 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:34509
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:52:07.006809 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39229
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:07.335171 13117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:07.335508 13117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:07.335701 13117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:07.343264 13117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:07.343437 13117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:07.343648 13117 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 06:52:07.343740 13117 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:52:07.343883 13117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:52:07.354385 13117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.205.126:39229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:07.355813 13117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:07.357311 13117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:07.370956 13125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:07.371049 13123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:07.371280 13122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:07.372099 13117 server_base.cc:1034] running on GCE node
I20260809 06:52:07.372838 13117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:07.373767 13117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:07.374976 13117 hybrid_clock.cc:648] HybridClock initialized: now 1786258327374935 us; error 32 us; skew 500 ppm
I20260809 06:52:07.375248 13117 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:07 dist-test-slave-0b58 krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258327, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:07.378463 13117 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:52:07.380187 13117 webserver.cc:460] Webserver started at http://127.10.205.66:36201/ using document root <none> and password file <none>
I20260809 06:52:07.380899 13117 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:07.381038 13117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:07.381367 13117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:07.384374 13117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "a1409fec04944e3f891b9130818254c8"
format_stamp: "Formatted at 2026-08-09 06:52:07 on dist-test-slave-0b58"
server_key: "dce7cfe8d62e915dc9fc7ecfa07ea1b1"
server_key_iv: "803db4c6be21c9f9ab14496b92042bc6"
server_key_version: "encryptionkey@0"
I20260809 06:52:07.385164 13117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "a1409fec04944e3f891b9130818254c8"
format_stamp: "Formatted at 2026-08-09 06:52:07 on dist-test-slave-0b58"
server_key: "dce7cfe8d62e915dc9fc7ecfa07ea1b1"
server_key_iv: "803db4c6be21c9f9ab14496b92042bc6"
server_key_version: "encryptionkey@0"
I20260809 06:52:07.390266 13117 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:52:07.393647 13132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:07.394928 13117 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 06:52:07.395104 13117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "a1409fec04944e3f891b9130818254c8"
format_stamp: "Formatted at 2026-08-09 06:52:07 on dist-test-slave-0b58"
server_key: "dce7cfe8d62e915dc9fc7ecfa07ea1b1"
server_key_iv: "803db4c6be21c9f9ab14496b92042bc6"
server_key_version: "encryptionkey@0"
I20260809 06:52:07.395321 13117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:07.425722 13117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:07.429901 13117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:07.430223 13117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:07.433255 13117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:07.433400 13117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:07.433555 13117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:07.433679 13117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:52:07 dist-test-slave-0b58 krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258327, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:07.459924 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:07.433801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:35447 (local address 127.10.205.126:39229)
0809 06:52:07.434017 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:07.434023 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:07.435484 (+ 1461us) server_negotiation.cc:407] Connection header received
0809 06:52:07.437668 (+ 2184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:07.437675 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:07.437775 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:07.437951 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:07.440987 (+ 3036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.441847 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.445350 (+ 3503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.446060 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.446228 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:07.451045 (+ 4817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:07.451050 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:07.451053 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:07.451087 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:07.454104 (+ 3017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:07.455151 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:07.455160 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:07.455166 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:07.455359 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:07.455893 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:07.455898 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:07.455902 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:07.456266 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:07.456495 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:07.459313 (+ 2818us) server_negotiation.cc:299] Negotiation successful
0809 06:52:07.459570 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 06:52:07.460167 13141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:07.434357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39229 (local address 127.10.205.66:35447)
0809 06:52:07.435295 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:07.435342 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:07.437353 (+ 2011us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:07.438435 (+ 1082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:07.438450 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:07.439426 (+ 976us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:07.440679 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:07.440709 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.442066 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.442075 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:07.445131 (+ 3056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:07.445151 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.446636 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.446648 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:07.446972 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:07.447850 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:07.447874 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:07.450800 (+ 2926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:07.454274 (+ 3474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:07.454287 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:07.454315 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:07.454982 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:07.455512 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:07.455521 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:07.455525 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:07.455719 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:07.456455 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:07.456464 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:07.457099 (+ 635us) client_negotiation.cc:769] Sending connection context
0809 06:52:07.457522 (+ 423us) client_negotiation.cc:240] Negotiation successful
0809 06:52:07.458299 (+ 777us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":431,"threads_started":1}
I20260809 06:52:07.481602 13117 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:41431
I20260809 06:52:07.481701 13255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:41431 every 8 connection(s)
I20260809 06:52:07.483130 13117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:52:07.485399 13256 heartbeater.cc:347] Connected to a master server at 127.10.205.126:39229
I20260809 06:52:07.485648 13256 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:07.486325 13256 heartbeater.cc:511] Master 127.10.205.126:39229 requested a full tablet report, sending...
I20260809 06:52:07.486864 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:07.469354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:39151 (local address 127.10.205.126:39229)
0809 06:52:07.469615 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:07.469624 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:07.470175 (+ 551us) server_negotiation.cc:407] Connection header received
0809 06:52:07.470408 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:07.470416 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:07.470520 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:07.470644 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:07.472499 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.473350 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.476126 (+ 2776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.476915 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.477030 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:07.480058 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:07.480063 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:07.480066 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:07.480098 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:07.483452 (+ 3354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:07.484531 (+ 1079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:07.484536 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:07.484540 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:07.484717 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:07.485207 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:07.485212 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:07.485215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:07.485703 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:07.485853 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:07.486301 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 06:52:07.486521 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:52:07.487004 13225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:07.469379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39229 (local address 127.10.205.66:39151)
0809 06:52:07.470054 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:07.470080 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:07.470249 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:07.470868 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:07.470876 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:07.471758 (+ 882us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:07.472348 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:07.472362 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.473531 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.473540 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:07.475913 (+ 2373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:07.475935 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.477385 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.477395 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:07.477632 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:07.478457 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:07.478496 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:07.479873 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:07.483584 (+ 3711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:07.483592 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:07.483597 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:07.484331 (+ 734us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:07.484919 (+ 588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:07.484925 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:07.484931 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:07.485085 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:07.485823 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:07.485827 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:07.486031 (+ 204us) client_negotiation.cc:769] Sending connection context
0809 06:52:07.486200 (+ 169us) client_negotiation.cc:240] Negotiation successful
0809 06:52:07.486542 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":361,"threads_started":1}
I20260809 06:52:07.487764 12900 ts_manager.cc:194] Registered new tserver with Master: a1409fec04944e3f891b9130818254c8 (127.10.205.66:41431)
I20260809 06:52:07.488677 12900 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:35447
I20260809 06:52:07.489171 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 13117
I20260809 06:52:07.489355 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:52:07.489894 11061 external_mini_cluster.cc:1428] Setting key f6cde5c2fc04bb77e3d654e58a548b9b
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:52:07.537767 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39229
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:07.868328 13261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:07.868667 13261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:07.868860 13261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:07.876143 13261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:07.876346 13261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:07.876524 13261 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 06:52:07.876617 13261 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:52:07.876735 13261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:52:07.887091 13261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.205.126:39229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:07.888495 13261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:07.889860 13261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:07.903352 13266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:07.903326 13269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:07.903414 13267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:07.904378 13261 server_base.cc:1034] running on GCE node
I20260809 06:52:07.904992 13261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:07.905941 13261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:07.907169 13261 hybrid_clock.cc:648] HybridClock initialized: now 1786258327907119 us; error 61 us; skew 500 ppm
I20260809 06:52:07.907503 13261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:07 dist-test-slave-0b58 krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258327, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:07.910643 13261 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:52:07.912168 13261 webserver.cc:460] Webserver started at http://127.10.205.67:37251/ using document root <none> and password file <none>
I20260809 06:52:07.912906 13261 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:07.913062 13261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:07.913408 13261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:07.916451 13261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "1fa8374afa1f40599d442ced5df6904d"
format_stamp: "Formatted at 2026-08-09 06:52:07 on dist-test-slave-0b58"
server_key: "07879821d600a4b56999a501faed6884"
server_key_iv: "42f4ca61589637b37b52ea7540439c4a"
server_key_version: "encryptionkey@0"
I20260809 06:52:07.917270 13261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "1fa8374afa1f40599d442ced5df6904d"
format_stamp: "Formatted at 2026-08-09 06:52:07 on dist-test-slave-0b58"
server_key: "07879821d600a4b56999a501faed6884"
server_key_iv: "42f4ca61589637b37b52ea7540439c4a"
server_key_version: "encryptionkey@0"
I20260809 06:52:07.922530 13261 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:52:07.926071 13276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:07.927469 13261 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:52:07.927646 13261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "1fa8374afa1f40599d442ced5df6904d"
format_stamp: "Formatted at 2026-08-09 06:52:07 on dist-test-slave-0b58"
server_key: "07879821d600a4b56999a501faed6884"
server_key_iv: "42f4ca61589637b37b52ea7540439c4a"
server_key_version: "encryptionkey@0"
I20260809 06:52:07.927862 13261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:07.942863 13261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:07.946906 13261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:07.947211 13261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:07.950328 13261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:07.950498 13261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:07.950685 13261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:07.950810 13261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:07.963369 13113 heartbeater.cc:503] Master 127.10.205.126:39229 was elected leader, sending a full tablet report...
Aug 09 06:52:07 dist-test-slave-0b58 krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258327, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:07.979023 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:07.950976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:49923 (local address 127.10.205.126:39229)
0809 06:52:07.951186 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:07.951194 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:07.952944 (+ 1750us) server_negotiation.cc:407] Connection header received
0809 06:52:07.956649 (+ 3705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:07.956658 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:07.956790 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:07.956899 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:07.960251 (+ 3352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.961776 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.964610 (+ 2834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.965157 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.965302 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:07.970779 (+ 5477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:07.970784 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:07.970787 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:07.970823 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:07.974955 (+ 4132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:07.975925 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:07.975935 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:07.975942 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:07.976161 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:07.976817 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:07.976824 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:07.976830 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:07.977249 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:07.977418 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:07.978387 (+ 969us) server_negotiation.cc:299] Negotiation successful
0809 06:52:07.978637 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:52:07.980449 13285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:07.951560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39229 (local address 127.10.205.67:49923)
0809 06:52:07.952746 (+ 1186us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:07.952808 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:07.956167 (+ 3359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:07.957633 (+ 1466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:07.957647 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:07.958732 (+ 1085us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:07.959908 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:07.959950 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.961984 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.961992 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:07.964442 (+ 2450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:07.964467 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.965412 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.965420 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:07.965751 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:07.966644 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:07.966686 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:07.970518 (+ 3832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:07.975173 (+ 4655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:07.975186 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:07.975214 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:07.975763 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:07.976355 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:07.976367 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:07.976370 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:07.976674 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:07.977418 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:07.977426 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:07.977921 (+ 495us) client_negotiation.cc:769] Sending connection context
0809 06:52:07.978261 (+ 340us) client_negotiation.cc:240] Negotiation successful
0809 06:52:07.978902 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":850,"thread_start_us":553,"threads_started":1}
I20260809 06:52:08.000408 13261 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:37037
I20260809 06:52:08.000514 13407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:37037 every 8 connection(s)
I20260809 06:52:08.002214 13261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:52:08.004556 13408 heartbeater.cc:347] Connected to a master server at 127.10.205.126:39229
I20260809 06:52:08.004841 13408 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:08.005132 13380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:07.988213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39229 (local address 127.10.205.67:39743)
0809 06:52:07.989082 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:07.989110 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:07.989320 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:07.989747 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:07.989752 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:07.990492 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:07.991109 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:07.991131 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.992550 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.992554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:07.994175 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:07.994195 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.995496 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.995506 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:07.995676 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:07.996368 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:07.996385 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:07.997540 (+ 1155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:08.002009 (+ 4469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:08.002012 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:08.002015 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:08.002474 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:08.002922 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:08.002933 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:08.002936 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:08.003106 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:08.003870 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:08.003877 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:08.004115 (+ 238us) client_negotiation.cc:769] Sending connection context
0809 06:52:08.004297 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 06:52:08.004666 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":427,"threads_started":1}
I20260809 06:52:08.005133 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:07.988524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:39743 (local address 127.10.205.126:39229)
0809 06:52:07.988682 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:07.988686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:07.989242 (+ 556us) server_negotiation.cc:407] Connection header received
0809 06:52:07.989496 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:07.989501 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:07.989579 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:07.989655 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:07.991320 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.992356 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.994369 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:07.995251 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:07.995418 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:07.997782 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:07.997793 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:07.997802 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:07.997858 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:08.001882 (+ 4024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:08.002577 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:08.002583 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:08.002587 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:08.002774 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:08.003266 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:08.003271 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:08.003273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:08.003647 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:08.003804 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.004435 (+ 631us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.004722 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 06:52:08.005856 13408 heartbeater.cc:511] Master 127.10.205.126:39229 requested a full tablet report, sending...
I20260809 06:52:08.007370 12900 ts_manager.cc:194] Registered new tserver with Master: 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037)
I20260809 06:52:08.008576 12900 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:49923
I20260809 06:52:08.009033 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 13261
I20260809 06:52:08.009248 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:52:08.009753 11061 external_mini_cluster.cc:1428] Setting key 2dadb20bfc2a8e9f43b38f2bd0c742ae
I20260809 06:52:08.012614 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 06:52:08 dist-test-slave-0b58 krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 06:52:08 dist-test-slave-0b58 krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:08.069351 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.054525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36090 (local address 127.10.205.126:39229)
0809 06:52:08.054745 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.054753 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.055010 (+ 257us) server_negotiation.cc:407] Connection header received
0809 06:52:08.055243 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.055247 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.055314 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.055426 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:08.056957 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.057732 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.059014 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.059459 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.059599 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.063668 (+ 4069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:08.063673 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:08.063676 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:08.063730 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:08.066608 (+ 2878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:08.067246 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:08.067253 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:08.067256 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:08.067402 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:08.067791 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:08.067802 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:08.067805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:08.068088 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:08.068380 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.068723 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.068991 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 06:52:08.073455 12900 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:52:08.080578 12900 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:08.105006 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.093274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43087 (local address 127.0.0.1:37570)
0809 06:52:08.094497 (+ 1223us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:08.094540 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:08.094752 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:08.096410 (+ 1658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:08.096419 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:08.096446 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:08.096907 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.096923 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.099163 (+ 2240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.099168 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.101763 (+ 2595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.101782 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.103864 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.103873 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.104074 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.104122 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 06:52:08.104283 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 06:52:08.104503 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":932,"mutex_wait_us":35,"thread_start_us":2601,"threads_started":1}
I20260809 06:52:08.105592 13425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.093684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37037 (local address 127.0.0.1:56946)
0809 06:52:08.096186 (+ 2502us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:08.096205 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:08.096445 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:08.097479 (+ 1034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:08.097484 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:08.097510 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:08.097913 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.097925 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.099906 (+ 1981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.099913 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.102188 (+ 2275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.102201 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.104414 (+ 2213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.104420 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.104589 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.104631 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 06:52:08.104715 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 06:52:08.104846 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2380,"mutex_wait_us":104,"thread_start_us":1072,"threads_started":1}
I20260809 06:52:08.106334 13424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.093337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37570 (local address 127.10.205.65:43087)
0809 06:52:08.095483 (+ 2146us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.095496 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.095533 (+ 37us) server_negotiation.cc:407] Connection header received
0809 06:52:08.095640 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.095648 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.096130 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.097121 (+ 991us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:08.097364 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.099008 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.101957 (+ 2949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.103618 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.105501 (+ 1883us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.105736 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.105814 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.106001 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1941,"thread_start_us":1800,"threads_started":1}
I20260809 06:52:08.106844 13427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.094461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56946 (local address 127.10.205.67:37037)
0809 06:52:08.096001 (+ 1540us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.096009 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.096339 (+ 330us) server_negotiation.cc:407] Connection header received
0809 06:52:08.096648 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.096659 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.096887 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.097095 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:08.098124 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.099740 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.102418 (+ 2678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.103837 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.103954 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.105051 (+ 1097us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.105135 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.106385 (+ 1250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1341,"thread_start_us":1112,"threads_started":1}
I20260809 06:52:08.110723 13040 tablet_service.cc:1467] Processing CreateTablet for tablet cf97343c162f49fe9484687485dabd23 (DEFAULT_TABLE table=test-table [id=bc8822626d134985a39130b7d7fd0f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:08.110719 13330 tablet_service.cc:1467] Processing CreateTablet for tablet cf97343c162f49fe9484687485dabd23 (DEFAULT_TABLE table=test-table [id=bc8822626d134985a39130b7d7fd0f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:08.112128 13040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf97343c162f49fe9484687485dabd23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:08.112157 13330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf97343c162f49fe9484687485dabd23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:08.114518 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.097268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:41431 (local address 127.0.0.1:52748)
0809 06:52:08.105235 (+ 7967us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:08.105253 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:08.105344 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:08.107611 (+ 2267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:08.107617 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:08.107643 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:08.107814 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.107824 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.110042 (+ 2218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.110047 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.111880 (+ 1833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.111895 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.113725 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.113733 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.113937 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.113972 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 06:52:08.114074 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 06:52:08.114210 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7876,"thread_start_us":9853,"threads_started":1}
I20260809 06:52:08.114634 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.096633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52748 (local address 127.10.205.66:41431)
0809 06:52:08.106993 (+ 10360us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.107003 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.107035 (+ 32us) server_negotiation.cc:407] Connection header received
0809 06:52:08.107140 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.107149 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.107405 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.107603 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:08.108382 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.109846 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.112063 (+ 2217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.113513 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.113673 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.113873 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.114156 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.114334 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10179,"thread_start_us":10044,"threads_started":1}
I20260809 06:52:08.118510 13184 tablet_service.cc:1467] Processing CreateTablet for tablet cf97343c162f49fe9484687485dabd23 (DEFAULT_TABLE table=test-table [id=bc8822626d134985a39130b7d7fd0f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:08.119937 13184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf97343c162f49fe9484687485dabd23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:08.124588 13431 tablet_bootstrap.cc:492] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa: Bootstrap starting.
I20260809 06:52:08.126787 13432 tablet_bootstrap.cc:492] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d: Bootstrap starting.
I20260809 06:52:08.128573 13431 tablet_bootstrap.cc:654] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:08.129894 13431 log.cc:824] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:08.130772 13432 tablet_bootstrap.cc:654] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:08.132032 13432 log.cc:824] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:08.133899 13431 tablet_bootstrap.cc:492] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa: No bootstrap required, opened a new log
I20260809 06:52:08.134251 13431 ts_tablet_manager.cc:1397] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 06:52:08.134737 13435 tablet_bootstrap.cc:492] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8: Bootstrap starting.
I20260809 06:52:08.137812 13435 tablet_bootstrap.cc:654] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:08.137916 13432 tablet_bootstrap.cc:492] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d: No bootstrap required, opened a new log
I20260809 06:52:08.138185 13432 ts_tablet_manager.cc:1397] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260809 06:52:08.138842 13435 log.cc:824] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:08.141342 13435 tablet_bootstrap.cc:492] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8: No bootstrap required, opened a new log
I20260809 06:52:08.141700 13435 ts_tablet_manager.cc:1397] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 06:52:08.144980 13431 raft_consensus.cc:348] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.145437 13431 raft_consensus.cc:374] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:08.145538 13431 raft_consensus.cc:729] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725534b1392246f4a0e87123c504fcaa, State: Initialized, Role: FOLLOWER
I20260809 06:52:08.146175 13431 consensus_queue.cc:260] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.148008 13431 ts_tablet_manager.cc:1428] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260809 06:52:08.148811 13432 raft_consensus.cc:348] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.149171 13432 raft_consensus.cc:374] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:08.149299 13432 raft_consensus.cc:729] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa8374afa1f40599d442ced5df6904d, State: Initialized, Role: FOLLOWER
I20260809 06:52:08.149982 13432 consensus_queue.cc:260] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.151072 13408 heartbeater.cc:503] Master 127.10.205.126:39229 was elected leader, sending a full tablet report...
I20260809 06:52:08.151808 13432 ts_tablet_manager.cc:1428] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d: Time spent starting tablet: real 0.013s user 0.011s sys 0.004s
I20260809 06:52:08.152906 13435 raft_consensus.cc:348] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.153352 13435 raft_consensus.cc:374] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:08.153470 13435 raft_consensus.cc:729] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1409fec04944e3f891b9130818254c8, State: Initialized, Role: FOLLOWER
I20260809 06:52:08.154085 13435 consensus_queue.cc:260] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.155304 13256 heartbeater.cc:503] Master 127.10.205.126:39229 was elected leader, sending a full tablet report...
I20260809 06:52:08.155886 13435 ts_tablet_manager.cc:1428] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8: Time spent starting tablet: real 0.014s user 0.000s sys 0.013s
I20260809 06:52:08.176780 13438 raft_consensus.cc:482] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:08.177114 13438 raft_consensus.cc:504] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.178788 13438 leader_election.cc:288] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1409fec04944e3f891b9130818254c8 (127.10.205.66:41431), 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037)
I20260809 06:52:08.186110 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.179258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:59001 (local address 127.10.205.66:41431)
0809 06:52:08.179604 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.179614 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.180382 (+ 768us) server_negotiation.cc:407] Connection header received
0809 06:52:08.180559 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.180565 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.180652 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.180739 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:08.181417 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.182302 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.184316 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.185101 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.185258 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.185357 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.185698 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.185840 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260809 06:52:08.186178 13427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.179342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:51565 (local address 127.10.205.67:37037)
0809 06:52:08.179581 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.179591 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.180527 (+ 936us) server_negotiation.cc:407] Connection header received
0809 06:52:08.180693 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.180697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.180793 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.180889 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:08.181615 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.182345 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.184379 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.185133 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.185343 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.185416 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.185790 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.185935 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 06:52:08.186221 13442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.179262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:41431 (local address 127.10.205.65:59001)
0809 06:52:08.180221 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:08.180246 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:08.180422 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:08.180785 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:08.180790 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:08.180815 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:08.181260 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.181274 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.182442 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.182451 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.184108 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.184121 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.185348 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.185355 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.185535 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.185558 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 06:52:08.185632 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 06:52:08.185770 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":814,"mutex_wait_us":1,"thread_start_us":586,"threads_started":1}
I20260809 06:52:08.186512 13441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.179329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37037 (local address 127.10.205.65:51565)
0809 06:52:08.180410 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:08.180428 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:08.180566 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:08.180955 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:08.180962 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:08.181005 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:08.181431 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.181443 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.182511 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.182515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.184199 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.184215 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.185418 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.185423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.185581 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.185603 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 06:52:08.185743 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 06:52:08.185867 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":889,"mutex_wait_us":41,"thread_start_us":496,"threads_started":1}
I20260809 06:52:08.187350 13204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf97343c162f49fe9484687485dabd23" candidate_uuid: "725534b1392246f4a0e87123c504fcaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1409fec04944e3f891b9130818254c8" is_pre_election: true
I20260809 06:52:08.187486 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf97343c162f49fe9484687485dabd23" candidate_uuid: "725534b1392246f4a0e87123c504fcaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa8374afa1f40599d442ced5df6904d" is_pre_election: true
I20260809 06:52:08.187901 13204 raft_consensus.cc:2454] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725534b1392246f4a0e87123c504fcaa in term 0.
I20260809 06:52:08.188002 13353 raft_consensus.cc:2454] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725534b1392246f4a0e87123c504fcaa in term 0.
I20260809 06:52:08.188663 12992 leader_election.cc:302] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725534b1392246f4a0e87123c504fcaa, a1409fec04944e3f891b9130818254c8; no voters:
I20260809 06:52:08.189060 13438 raft_consensus.cc:2781] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:08.189224 13438 raft_consensus.cc:482] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:08.189340 13438 raft_consensus.cc:3037] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:08.191706 13438 raft_consensus.cc:504] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.192549 13438 leader_election.cc:288] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [CANDIDATE]: Term 1 election: Requested vote from peers a1409fec04944e3f891b9130818254c8 (127.10.205.66:41431), 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037)
I20260809 06:52:08.192955 13204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf97343c162f49fe9484687485dabd23" candidate_uuid: "725534b1392246f4a0e87123c504fcaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1409fec04944e3f891b9130818254c8"
I20260809 06:52:08.193055 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf97343c162f49fe9484687485dabd23" candidate_uuid: "725534b1392246f4a0e87123c504fcaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa8374afa1f40599d442ced5df6904d"
I20260809 06:52:08.193202 13204 raft_consensus.cc:3037] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:08.193262 13353 raft_consensus.cc:3037] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:08.196540 13353 raft_consensus.cc:2454] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725534b1392246f4a0e87123c504fcaa in term 1.
I20260809 06:52:08.196540 13204 raft_consensus.cc:2454] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725534b1392246f4a0e87123c504fcaa in term 1.
I20260809 06:52:08.196991 12991 leader_election.cc:302] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fa8374afa1f40599d442ced5df6904d, 725534b1392246f4a0e87123c504fcaa; no voters:
I20260809 06:52:08.197345 13438 raft_consensus.cc:2781] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:08.197816 13438 raft_consensus.cc:686] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 1 LEADER]: Becoming Leader. State: Replica: 725534b1392246f4a0e87123c504fcaa, State: Running, Role: LEADER
I20260809 06:52:08.198325 13438 consensus_queue.cc:237] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.203263 12901 catalog_manager.cc:5495] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 725534b1392246f4a0e87123c504fcaa (127.10.205.65). New cstate: current_term: 1 leader_uuid: "725534b1392246f4a0e87123c504fcaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } health_report { overall_health: UNKNOWN } } }
W20260809 06:52:08.206152 13114 tablet.cc:2369] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:52:08.235303 13257 tablet.cc:2369] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 06:52:08 dist-test-slave-0b58 krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258326, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
W20260809 06:52:08.254232 13409 tablet.cc:2369] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:52:08.256603 13452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.242779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39229 (local address 127.0.0.1:36104)
0809 06:52:08.243320 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:08.243336 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:08.243466 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:08.243809 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:08.243812 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:08.244550 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:08.244854 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.244864 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.245837 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.245840 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.246843 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.246855 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.247530 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.247535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.247653 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.248419 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:08.248437 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:08.251062 (+ 2625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:08.254027 (+ 2965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:08.254042 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:08.254049 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:08.254676 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:08.255085 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:08.255090 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:08.255094 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:08.255246 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:08.255729 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:08.255735 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:08.255879 (+ 144us) client_negotiation.cc:769] Sending connection context
0809 06:52:08.256014 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 06:52:08.256221 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":288,"threads_started":1}
I20260809 06:52:08.256647 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.242756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36104 (local address 127.10.205.126:39229)
0809 06:52:08.242937 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.242941 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.243420 (+ 479us) server_negotiation.cc:407] Connection header received
0809 06:52:08.243566 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.243570 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.243661 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.243753 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:08.244981 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.245713 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.246962 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.247371 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.247460 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.251256 (+ 3796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:08.251260 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:08.251264 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:08.251296 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:08.253874 (+ 2578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:08.254821 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:08.254825 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:08.254827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:08.254966 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:08.255341 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:08.255344 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:08.255346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:08.255610 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:08.255721 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.256106 (+ 385us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.256402 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":65}
I20260809 06:52:08.261615 12901 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:36104:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 06:52:08.262578 12901 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:08.269451 13040 tablet_service.cc:1467] Processing CreateTablet for tablet dd0ce0390f0a45669a335b40855376bb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3b9f6a529e3345a6aec3511e8032d145]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:52:08.269526 13184 tablet_service.cc:1467] Processing CreateTablet for tablet dd0ce0390f0a45669a335b40855376bb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3b9f6a529e3345a6aec3511e8032d145]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:52:08.269789 13330 tablet_service.cc:1467] Processing CreateTablet for tablet dd0ce0390f0a45669a335b40855376bb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3b9f6a529e3345a6aec3511e8032d145]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:52:08.270457 13040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd0ce0390f0a45669a335b40855376bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:08.270468 13184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd0ce0390f0a45669a335b40855376bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:08.270563 13330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd0ce0390f0a45669a335b40855376bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:08.276439 13431 tablet_bootstrap.cc:492] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: Bootstrap starting.
I20260809 06:52:08.277746 13435 tablet_bootstrap.cc:492] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8: Bootstrap starting.
I20260809 06:52:08.277776 13432 tablet_bootstrap.cc:492] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d: Bootstrap starting.
I20260809 06:52:08.277879 13431 tablet_bootstrap.cc:654] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:08.279227 13435 tablet_bootstrap.cc:654] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:08.279572 13432 tablet_bootstrap.cc:654] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:08.280314 13431 tablet_bootstrap.cc:492] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: No bootstrap required, opened a new log
I20260809 06:52:08.280483 13431 ts_tablet_manager.cc:1397] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.001s
I20260809 06:52:08.281437 13431 raft_consensus.cc:348] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.281711 13431 raft_consensus.cc:374] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:08.281818 13431 raft_consensus.cc:729] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725534b1392246f4a0e87123c504fcaa, State: Initialized, Role: FOLLOWER
I20260809 06:52:08.282136 13435 tablet_bootstrap.cc:492] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8: No bootstrap required, opened a new log
I20260809 06:52:08.282136 13432 tablet_bootstrap.cc:492] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d: No bootstrap required, opened a new log
I20260809 06:52:08.282023 13431 consensus_queue.cc:260] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.282295 13432 ts_tablet_manager.cc:1397] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 06:52:08.282295 13435 ts_tablet_manager.cc:1397] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 06:52:08.282647 13431 ts_tablet_manager.cc:1428] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 06:52:08.282526 13438 tablet_replica.cc:439] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } } }
I20260809 06:52:08.282826 13438 tablet_replica.cc:442] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:08.283051 13435 raft_consensus.cc:348] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.283079 13432 raft_consensus.cc:348] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.283321 13435 raft_consensus.cc:374] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:08.283327 13432 raft_consensus.cc:374] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:08.283416 13432 raft_consensus.cc:729] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa8374afa1f40599d442ced5df6904d, State: Initialized, Role: FOLLOWER
I20260809 06:52:08.283416 13435 raft_consensus.cc:729] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1409fec04944e3f891b9130818254c8, State: Initialized, Role: FOLLOWER
I20260809 06:52:08.283624 13435 consensus_queue.cc:260] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.283625 13432 consensus_queue.cc:260] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.284196 13435 ts_tablet_manager.cc:1428] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260809 06:52:08.284198 13432 ts_tablet_manager.cc:1428] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 06:52:08.284593 13440 tablet_replica.cc:439] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } } }
I20260809 06:52:08.284904 13440 tablet_replica.cc:442] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:08.285154 13439 tablet_replica.cc:439] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } } }
I20260809 06:52:08.285492 13439 tablet_replica.cc:442] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:08.381410 13438 raft_consensus.cc:482] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:08.381639 13438 raft_consensus.cc:504] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.382344 13438 leader_election.cc:288] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1409fec04944e3f891b9130818254c8 (127.10.205.66:41431), 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037)
I20260809 06:52:08.382975 13204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd0ce0390f0a45669a335b40855376bb" candidate_uuid: "725534b1392246f4a0e87123c504fcaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1409fec04944e3f891b9130818254c8" is_pre_election: true
I20260809 06:52:08.383015 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd0ce0390f0a45669a335b40855376bb" candidate_uuid: "725534b1392246f4a0e87123c504fcaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa8374afa1f40599d442ced5df6904d" is_pre_election: true
I20260809 06:52:08.383278 13204 raft_consensus.cc:2454] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725534b1392246f4a0e87123c504fcaa in term 0.
I20260809 06:52:08.383306 13353 raft_consensus.cc:2454] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725534b1392246f4a0e87123c504fcaa in term 0.
I20260809 06:52:08.383769 12992 leader_election.cc:302] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725534b1392246f4a0e87123c504fcaa, a1409fec04944e3f891b9130818254c8; no voters:
I20260809 06:52:08.384132 13438 raft_consensus.cc:2781] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:08.384234 13438 raft_consensus.cc:482] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:08.384408 13438 raft_consensus.cc:3037] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:08.386500 13438 raft_consensus.cc:504] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.387076 13438 leader_election.cc:288] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [CANDIDATE]: Term 1 election: Requested vote from peers a1409fec04944e3f891b9130818254c8 (127.10.205.66:41431), 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037)
I20260809 06:52:08.387516 13204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd0ce0390f0a45669a335b40855376bb" candidate_uuid: "725534b1392246f4a0e87123c504fcaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1409fec04944e3f891b9130818254c8"
I20260809 06:52:08.387553 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd0ce0390f0a45669a335b40855376bb" candidate_uuid: "725534b1392246f4a0e87123c504fcaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa8374afa1f40599d442ced5df6904d"
I20260809 06:52:08.387737 13204 raft_consensus.cc:3037] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:08.387784 13353 raft_consensus.cc:3037] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:08.389762 13353 raft_consensus.cc:2454] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725534b1392246f4a0e87123c504fcaa in term 1.
I20260809 06:52:08.389834 13204 raft_consensus.cc:2454] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725534b1392246f4a0e87123c504fcaa in term 1.
I20260809 06:52:08.390228 12991 leader_election.cc:302] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fa8374afa1f40599d442ced5df6904d, 725534b1392246f4a0e87123c504fcaa; no voters:
I20260809 06:52:08.390506 13438 raft_consensus.cc:2781] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:08.390695 13438 raft_consensus.cc:686] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [term 1 LEADER]: Becoming Leader. State: Replica: 725534b1392246f4a0e87123c504fcaa, State: Running, Role: LEADER
I20260809 06:52:08.390949 13438 consensus_queue.cc:237] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.392469 13443 tablet_replica.cc:439] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: TxnStatusTablet state changed. Reason: New leader 725534b1392246f4a0e87123c504fcaa. Latest consensus state: current_term: 1 leader_uuid: "725534b1392246f4a0e87123c504fcaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } } }
I20260809 06:52:08.392899 13443 tablet_replica.cc:442] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:52:08.393718 13457 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 06:52:08.394021 13457 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 06:52:08.394258 12901 catalog_manager.cc:5495] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 725534b1392246f4a0e87123c504fcaa (127.10.205.65). New cstate: current_term: 1 leader_uuid: "725534b1392246f4a0e87123c504fcaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } health_report { overall_health: UNKNOWN } } }
I20260809 06:52:08.439952 13452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.433605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43087 (local address 127.0.0.1:37586)
0809 06:52:08.433944 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:08.433961 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:08.434078 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:08.434612 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:08.434616 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:08.434627 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:52:08.434772 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.434779 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.436199 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.436203 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.437297 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.437310 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.438271 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.438275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.438433 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.438486 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:52:08.439514 (+ 1028us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:52:08.439531 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 06:52:08.439593 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 06:52:08.439713 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192}
I20260809 06:52:08.439989 13424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.433531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37586 (local address 127.10.205.65:43087)
0809 06:52:08.433748 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.433755 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.434037 (+ 282us) server_negotiation.cc:407] Connection header received
0809 06:52:08.434276 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.434282 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.434425 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.434585 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:08.434904 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.436062 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.437439 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.438110 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.438247 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.438692 (+ 445us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:08.439405 (+ 713us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:08.439559 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.439614 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.439697 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 06:52:08.447855 13353 raft_consensus.cc:1261] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Refusing update from remote peer 725534b1392246f4a0e87123c504fcaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:08.448173 13204 raft_consensus.cc:1261] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Refusing update from remote peer 725534b1392246f4a0e87123c504fcaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:08.449177 13438 consensus_queue.cc:1035] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:08.449582 13443 consensus_queue.cc:1035] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:08.461030 13440 tablet_replica.cc:439] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8: TxnStatusTablet state changed. Reason: New leader 725534b1392246f4a0e87123c504fcaa. Latest consensus state: current_term: 1 leader_uuid: "725534b1392246f4a0e87123c504fcaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } } }
I20260809 06:52:08.461381 13440 tablet_replica.cc:442] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:08.465742 13439 tablet_replica.cc:439] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d: TxnStatusTablet state changed. Reason: New leader 725534b1392246f4a0e87123c504fcaa. Latest consensus state: current_term: 1 leader_uuid: "725534b1392246f4a0e87123c504fcaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } } }
I20260809 06:52:08.466053 13439 tablet_replica.cc:442] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:08.467283 13443 tablet_replica.cc:439] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "725534b1392246f4a0e87123c504fcaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } } }
I20260809 06:52:08.467545 13443 tablet_replica.cc:442] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:52:08.471501 13462 mvcc.cc:205] Tried to move back new op lower bound from 7316514113312763904 to 7316514113091293184. Current Snapshot: MvccSnapshot[applied={T|T < 7316514113312763904}]
I20260809 06:52:08.474714 13440 tablet_replica.cc:439] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "725534b1392246f4a0e87123c504fcaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } } }
I20260809 06:52:08.474963 13440 tablet_replica.cc:442] T dd0ce0390f0a45669a335b40855376bb P a1409fec04944e3f891b9130818254c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:08.477932 13466 tablet_replica.cc:439] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "725534b1392246f4a0e87123c504fcaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } } }
I20260809 06:52:08.478309 13466 tablet_replica.cc:442] T dd0ce0390f0a45669a335b40855376bb P 725534b1392246f4a0e87123c504fcaa: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:52:08.480830 13439 tablet_replica.cc:439] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "725534b1392246f4a0e87123c504fcaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } } }
I20260809 06:52:08.481079 13439 tablet_replica.cc:442] T dd0ce0390f0a45669a335b40855376bb P 1fa8374afa1f40599d442ced5df6904d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:08.489416 13424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.479363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37594 (local address 127.10.205.65:43087)
0809 06:52:08.479538 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.479544 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.479560 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:52:08.479623 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.479628 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.479707 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.479790 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:08.484575 (+ 4785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.485455 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.487469 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.487912 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.488074 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.488596 (+ 522us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:08.488725 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:08.488833 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.488997 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.489081 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:52:08.507102 13424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.500737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:34277 (local address 127.10.205.65:43087)
0809 06:52:08.500930 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.500936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.501607 (+ 671us) server_negotiation.cc:407] Connection header received
0809 06:52:08.501822 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.501826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.501895 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.501981 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:08.502568 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.503336 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.504922 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.505532 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.505657 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.506298 (+ 641us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:08.506428 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:08.506478 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.506651 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.506729 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":61}
I20260809 06:52:08.507450 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.500773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43087 (local address 127.10.205.65:34277)
0809 06:52:08.501509 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:08.501526 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:08.501697 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:08.502006 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:08.502010 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:08.502027 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:52:08.502416 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.502425 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.503471 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.503476 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.504782 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.504794 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.505811 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.505817 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.505974 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.506048 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:52:08.506526 (+ 478us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:52:08.506532 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:52:08.506633 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 06:52:08.506774 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":3,"thread_start_us":399,"threads_started":1}
I20260809 06:52:08.517197 13204 raft_consensus.cc:1261] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Refusing update from remote peer 725534b1392246f4a0e87123c504fcaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:08.517815 13353 raft_consensus.cc:1261] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Refusing update from remote peer 725534b1392246f4a0e87123c504fcaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:08.517792 13443 consensus_queue.cc:1035] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:08.518551 13443 consensus_queue.cc:1035] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:08.526201 13460 mvcc.cc:205] Tried to move back new op lower bound from 7316514113601028096 to 7316514112304320512. Current Snapshot: MvccSnapshot[applied={T|T < 7316514113601028096}]
I20260809 06:52:08.591612 12901 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:08.591914 12901 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:08.595371 12901 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b: Sending DeleteTablet for 3 replicas of tablet cf97343c162f49fe9484687485dabd23
I20260809 06:52:08.596606 13184 tablet_service.cc:1514] Processing DeleteTablet for tablet cf97343c162f49fe9484687485dabd23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:08 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:52748
I20260809 06:52:08.596773 13330 tablet_service.cc:1514] Processing DeleteTablet for tablet cf97343c162f49fe9484687485dabd23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:08 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:56946
I20260809 06:52:08.596796 13040 tablet_service.cc:1514] Processing DeleteTablet for tablet cf97343c162f49fe9484687485dabd23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:08 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:37570
I20260809 06:52:08.598609 12901 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:52:08.599542 12901 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:08.608017 13183 tablet_service.cc:1467] Processing CreateTablet for tablet ab773d2d847043e786841d09a74f49c8 (DEFAULT_TABLE table=test-table [id=c176650c54db4a7593fe3403f906f266]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:08.608841 13183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab773d2d847043e786841d09a74f49c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:08.610761 13039 tablet_service.cc:1467] Processing CreateTablet for tablet ab773d2d847043e786841d09a74f49c8 (DEFAULT_TABLE table=test-table [id=c176650c54db4a7593fe3403f906f266]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:08.611461 13039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab773d2d847043e786841d09a74f49c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:08.612560 13479 tablet_replica.cc:330] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8: stopping tablet replica
I20260809 06:52:08.612731 13328 tablet_service.cc:1467] Processing CreateTablet for tablet ab773d2d847043e786841d09a74f49c8 (DEFAULT_TABLE table=test-table [id=c176650c54db4a7593fe3403f906f266]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:08.613034 13479 raft_consensus.cc:2229] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:08.613214 13328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab773d2d847043e786841d09a74f49c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:08.613413 13479 raft_consensus.cc:2258] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:08.615545 13479 ts_tablet_manager.cc:1905] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:08.618752 13431 tablet_bootstrap.cc:492] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa: Bootstrap starting.
I20260809 06:52:08.620697 13431 tablet_bootstrap.cc:654] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:08.623775 13479 ts_tablet_manager.cc:1918] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:52:08.623989 13479 log.cc:1196] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/cf97343c162f49fe9484687485dabd23
I20260809 06:52:08.624645 13479 ts_tablet_manager.cc:1939] T cf97343c162f49fe9484687485dabd23 P a1409fec04944e3f891b9130818254c8: Deleting consensus metadata
I20260809 06:52:08.626832 12885 catalog_manager.cc:4841] TS a1409fec04944e3f891b9130818254c8 (127.10.205.66:41431): tablet cf97343c162f49fe9484687485dabd23 (table test-table [id=bc8822626d134985a39130b7d7fd0f38]) successfully deleted
I20260809 06:52:08.627099 13481 tablet_replica.cc:330] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa: stopping tablet replica
I20260809 06:52:08.627622 13481 raft_consensus.cc:2229] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:08.628440 13481 raft_consensus.cc:2258] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:08.629374 13480 tablet_replica.cc:330] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d: stopping tablet replica
I20260809 06:52:08.629916 13435 tablet_bootstrap.cc:492] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8: Bootstrap starting.
I20260809 06:52:08.629904 13480 raft_consensus.cc:2229] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:08.630298 13480 raft_consensus.cc:2258] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:08.631565 13432 tablet_bootstrap.cc:492] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d: Bootstrap starting.
I20260809 06:52:08.631752 13435 tablet_bootstrap.cc:654] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:08.633359 13432 tablet_bootstrap.cc:654] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:08.638550 13480 ts_tablet_manager.cc:1905] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:08.639314 13431 tablet_bootstrap.cc:492] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa: No bootstrap required, opened a new log
I20260809 06:52:08.639518 13431 ts_tablet_manager.cc:1397] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.007s
I20260809 06:52:08.640329 13431 raft_consensus.cc:348] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.640589 13431 raft_consensus.cc:374] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:08.640661 13431 raft_consensus.cc:729] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725534b1392246f4a0e87123c504fcaa, State: Initialized, Role: FOLLOWER
I20260809 06:52:08.641130 13431 consensus_queue.cc:260] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.641742 13431 ts_tablet_manager.cc:1428] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 06:52:08.644740 13481 ts_tablet_manager.cc:1905] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:08.644886 13480 ts_tablet_manager.cc:1918] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:52:08.645076 13480 log.cc:1196] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/cf97343c162f49fe9484687485dabd23
I20260809 06:52:08.645605 13480 ts_tablet_manager.cc:1939] T cf97343c162f49fe9484687485dabd23 P 1fa8374afa1f40599d442ced5df6904d: Deleting consensus metadata
I20260809 06:52:08.647428 12884 catalog_manager.cc:4841] TS 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037): tablet cf97343c162f49fe9484687485dabd23 (table test-table [id=bc8822626d134985a39130b7d7fd0f38]) successfully deleted
I20260809 06:52:08.648370 13435 tablet_bootstrap.cc:492] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8: No bootstrap required, opened a new log
I20260809 06:52:08.648564 13435 ts_tablet_manager.cc:1397] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.002s
I20260809 06:52:08.649437 13435 raft_consensus.cc:348] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.649677 13435 raft_consensus.cc:374] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:08.649811 13435 raft_consensus.cc:729] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1409fec04944e3f891b9130818254c8, State: Initialized, Role: FOLLOWER
I20260809 06:52:08.650123 13435 consensus_queue.cc:260] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.653823 13435 ts_tablet_manager.cc:1428] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260809 06:52:08.654488 13481 ts_tablet_manager.cc:1918] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:52:08.654721 13481 log.cc:1196] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/cf97343c162f49fe9484687485dabd23
I20260809 06:52:08.655441 13481 ts_tablet_manager.cc:1939] T cf97343c162f49fe9484687485dabd23 P 725534b1392246f4a0e87123c504fcaa: Deleting consensus metadata
I20260809 06:52:08.657234 12885 catalog_manager.cc:4841] TS 725534b1392246f4a0e87123c504fcaa (127.10.205.65:43087): tablet cf97343c162f49fe9484687485dabd23 (table test-table [id=bc8822626d134985a39130b7d7fd0f38]) successfully deleted
I20260809 06:52:08.659003 13432 tablet_bootstrap.cc:492] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d: No bootstrap required, opened a new log
I20260809 06:52:08.659178 13432 ts_tablet_manager.cc:1397] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.018s
I20260809 06:52:08.659984 13432 raft_consensus.cc:348] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.660238 13432 raft_consensus.cc:374] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:08.660351 13432 raft_consensus.cc:729] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa8374afa1f40599d442ced5df6904d, State: Initialized, Role: FOLLOWER
I20260809 06:52:08.660605 13432 consensus_queue.cc:260] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.661211 13432 ts_tablet_manager.cc:1428] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 06:52:08.878094 13440 raft_consensus.cc:482] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:08.878401 13440 raft_consensus.cc:504] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.879916 13440 leader_election.cc:288] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 725534b1392246f4a0e87123c504fcaa (127.10.205.65:43087), 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037)
I20260809 06:52:08.891016 13424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.880535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:45551 (local address 127.10.205.65:43087)
0809 06:52:08.880977 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.880984 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.881083 (+ 99us) server_negotiation.cc:407] Connection header received
0809 06:52:08.881541 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.881550 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.881658 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.881746 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:08.882611 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.884121 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.887536 (+ 3415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.889440 (+ 1904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.889629 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.889747 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.890559 (+ 812us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.890729 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283}
I20260809 06:52:08.891832 13485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.880114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43087 (local address 127.10.205.66:45551)
0809 06:52:08.880969 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:08.880992 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:08.881238 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:08.882017 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:08.882024 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:08.882064 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:08.882402 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.882417 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.884478 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.884486 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.887267 (+ 2781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.887295 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.889923 (+ 2628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.889931 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.890293 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.890348 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 06:52:08.891319 (+ 971us) client_negotiation.cc:240] Negotiation successful
0809 06:52:08.891470 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":645,"threads_started":1}
I20260809 06:52:08.892863 13061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab773d2d847043e786841d09a74f49c8" candidate_uuid: "a1409fec04944e3f891b9130818254c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725534b1392246f4a0e87123c504fcaa" is_pre_election: true
I20260809 06:52:08.893438 13061 raft_consensus.cc:2454] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1409fec04944e3f891b9130818254c8 in term 0.
I20260809 06:52:08.894155 13135 leader_election.cc:302] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725534b1392246f4a0e87123c504fcaa, a1409fec04944e3f891b9130818254c8; no voters:
I20260809 06:52:08.894613 13440 raft_consensus.cc:2781] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:08.894753 13440 raft_consensus.cc:482] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:08.894912 13440 raft_consensus.cc:3037] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:08.897652 13440 raft_consensus.cc:504] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.898077 13488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.880283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37037 (local address 127.10.205.66:38423)
0809 06:52:08.891240 (+ 10957us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:08.891263 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:08.891408 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:08.891799 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:08.891805 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:08.891840 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:08.892199 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.892211 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.893333 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.893342 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.895236 (+ 1894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.895253 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.897073 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.897081 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.897301 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.897339 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 06:52:08.897443 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 06:52:08.897591 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10813,"thread_start_us":10737,"threads_started":1}
I20260809 06:52:08.898283 13487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.880615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:38423 (local address 127.10.205.67:37037)
0809 06:52:08.891006 (+ 10391us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.891015 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.891456 (+ 441us) server_negotiation.cc:407] Connection header received
0809 06:52:08.891542 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.891548 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.891631 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.891741 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:08.892398 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.893136 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.895512 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.896838 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.897005 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.897083 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.897493 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.897649 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10241,"thread_start_us":10113,"threads_started":1}
I20260809 06:52:08.898509 13440 leader_election.cc:288] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [CANDIDATE]: Term 1 election: Requested vote from peers 725534b1392246f4a0e87123c504fcaa (127.10.205.65:43087), 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037)
I20260809 06:52:08.899022 13061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab773d2d847043e786841d09a74f49c8" candidate_uuid: "a1409fec04944e3f891b9130818254c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725534b1392246f4a0e87123c504fcaa"
I20260809 06:52:08.899106 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab773d2d847043e786841d09a74f49c8" candidate_uuid: "a1409fec04944e3f891b9130818254c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa8374afa1f40599d442ced5df6904d" is_pre_election: true
I20260809 06:52:08.899241 13061 raft_consensus.cc:3037] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:08.899223 13351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab773d2d847043e786841d09a74f49c8" candidate_uuid: "a1409fec04944e3f891b9130818254c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa8374afa1f40599d442ced5df6904d"
I20260809 06:52:08.899359 13353 raft_consensus.cc:2454] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1409fec04944e3f891b9130818254c8 in term 0.
I20260809 06:52:08.901859 13061 raft_consensus.cc:2454] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1409fec04944e3f891b9130818254c8 in term 1.
I20260809 06:52:08.902271 13135 leader_election.cc:302] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 725534b1392246f4a0e87123c504fcaa, a1409fec04944e3f891b9130818254c8; no voters: 1fa8374afa1f40599d442ced5df6904d
I20260809 06:52:08.902629 13440 raft_consensus.cc:2781] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:08.903079 13440 raft_consensus.cc:686] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 1 LEADER]: Becoming Leader. State: Replica: a1409fec04944e3f891b9130818254c8, State: Running, Role: LEADER
I20260809 06:52:08.903501 13440 consensus_queue.cc:237] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:08.907631 12901 catalog_manager.cc:5495] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1409fec04944e3f891b9130818254c8 (127.10.205.66). New cstate: current_term: 1 leader_uuid: "a1409fec04944e3f891b9130818254c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } health_report { overall_health: UNKNOWN } } }
I20260809 06:52:08.954326 13491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.943225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52750 (local address 127.10.205.66:41431)
0809 06:52:08.948441 (+ 5216us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.948445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.948466 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:52:08.948572 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.948579 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.948679 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.948895 (+ 216us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:08.949366 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.950343 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.951831 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.952376 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.952506 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.953039 (+ 533us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:08.953628 (+ 589us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:08.953851 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.953903 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.953984 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5093,"thread_start_us":4895,"threads_started":1}
I20260809 06:52:08.972828 13424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.966896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:41441 (local address 127.10.205.65:43087)
0809 06:52:08.967091 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:08.967099 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:08.967760 (+ 661us) server_negotiation.cc:407] Connection header received
0809 06:52:08.968010 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:08.968017 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:08.968103 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:08.968162 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:08.968810 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.969602 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.970952 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.971399 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.971527 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.971965 (+ 438us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:08.972099 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:08.972202 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:08.972383 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 06:52:08.972467 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:52:08.972878 13494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:08.966943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43087 (local address 127.10.205.66:41441)
0809 06:52:08.967656 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:08.967672 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:08.967830 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:08.968378 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:08.968381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:08.968392 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:52:08.968643 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.968650 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.969741 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.969747 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.970816 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:08.970826 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:08.971588 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:08.971595 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:08.971740 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:08.971797 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:52:08.972203 (+ 406us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:52:08.972217 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 06:52:08.972338 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 06:52:08.972474 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":374,"threads_started":1}
I20260809 06:52:08.982049 13351 raft_consensus.cc:3037] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:08.982709 13061 raft_consensus.cc:1261] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Refusing update from remote peer a1409fec04944e3f891b9130818254c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:08.983448 13440 consensus_queue.cc:1035] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:08.985566 13351 raft_consensus.cc:1261] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Refusing update from remote peer a1409fec04944e3f891b9130818254c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:08.986182 13440 consensus_queue.cc:1035] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:08.996209 13461 mvcc.cc:205] Tried to move back new op lower bound from 7316514115504975872 to 7316514115193769984. Current Snapshot: MvccSnapshot[applied={T|T < 7316514115504975872}]
I20260809 06:52:09.020048 13491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:09.013362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:33947 (local address 127.10.205.66:41431)
0809 06:52:09.013540 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:09.013546 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:09.014076 (+ 530us) server_negotiation.cc:407] Connection header received
0809 06:52:09.014349 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:09.014354 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:09.014442 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:09.014505 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:09.015185 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:09.016290 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:09.018047 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:09.018523 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:09.018643 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:09.019207 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:09.019343 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:09.019413 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:09.019652 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 06:52:09.019739 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:52:09.020819 13499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:09.013157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:41431 (local address 127.10.205.65:33947)
0809 06:52:09.013985 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:09.014005 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:09.014186 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:09.014717 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:09.014721 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:09.014733 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:52:09.015012 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:09.015028 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:09.016482 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:09.016488 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:09.017898 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:09.017910 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:09.018766 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:09.018772 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:09.018974 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:09.019024 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:52:09.019501 (+ 477us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:52:09.019513 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 06:52:09.020243 (+ 730us) client_negotiation.cc:240] Negotiation successful
0809 06:52:09.020411 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":4218,"threads_started":1}
W20260809 06:52:09.021924 13462 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 06:52:10.629328 12898 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:10.629537 12898 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:10.633872 12898 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b: Sending DeleteTablet for 3 replicas of tablet ab773d2d847043e786841d09a74f49c8
I20260809 06:52:10.634706 13040 tablet_service.cc:1514] Processing DeleteTablet for tablet ab773d2d847043e786841d09a74f49c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:10 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:37570
I20260809 06:52:10.634812 13328 tablet_service.cc:1514] Processing DeleteTablet for tablet ab773d2d847043e786841d09a74f49c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:10 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:56946
I20260809 06:52:10.634891 13183 tablet_service.cc:1514] Processing DeleteTablet for tablet ab773d2d847043e786841d09a74f49c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:10 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:52748
I20260809 06:52:10.653501 13525 tablet_replica.cc:330] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa: stopping tablet replica
I20260809 06:52:10.653873 13525 raft_consensus.cc:2229] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:10.654287 13525 raft_consensus.cc:2258] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:10.654374 13526 tablet_replica.cc:330] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d: stopping tablet replica
I20260809 06:52:10.654639 13526 raft_consensus.cc:2229] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:10.654888 13527 tablet_replica.cc:330] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8: stopping tablet replica
I20260809 06:52:10.654950 13526 raft_consensus.cc:2258] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:10.655182 13527 raft_consensus.cc:2229] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:10.655591 13525 ts_tablet_manager.cc:1905] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:10.655891 13527 raft_consensus.cc:2258] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:10.656090 13526 ts_tablet_manager.cc:1905] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:10.660228 13527 ts_tablet_manager.cc:1905] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:10.662585 13525 ts_tablet_manager.cc:1918] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 06:52:10.662784 13525 log.cc:1196] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/ab773d2d847043e786841d09a74f49c8
I20260809 06:52:10.662982 13526 ts_tablet_manager.cc:1918] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 06:52:10.663290 13526 log.cc:1196] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/ab773d2d847043e786841d09a74f49c8
I20260809 06:52:10.663462 13525 ts_tablet_manager.cc:1939] T ab773d2d847043e786841d09a74f49c8 P 725534b1392246f4a0e87123c504fcaa: Deleting consensus metadata
I20260809 06:52:10.663887 13526 ts_tablet_manager.cc:1939] T ab773d2d847043e786841d09a74f49c8 P 1fa8374afa1f40599d442ced5df6904d: Deleting consensus metadata
I20260809 06:52:10.664880 12885 catalog_manager.cc:4841] TS 725534b1392246f4a0e87123c504fcaa (127.10.205.65:43087): tablet ab773d2d847043e786841d09a74f49c8 (table test-table [id=c176650c54db4a7593fe3403f906f266]) successfully deleted
I20260809 06:52:10.665177 12884 catalog_manager.cc:4841] TS 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037): tablet ab773d2d847043e786841d09a74f49c8 (table test-table [id=c176650c54db4a7593fe3403f906f266]) successfully deleted
I20260809 06:52:10.667934 13527 ts_tablet_manager.cc:1918] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 06:52:10.668057 13527 log.cc:1196] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/ab773d2d847043e786841d09a74f49c8
I20260809 06:52:10.668553 13527 ts_tablet_manager.cc:1939] T ab773d2d847043e786841d09a74f49c8 P a1409fec04944e3f891b9130818254c8: Deleting consensus metadata
I20260809 06:52:10.669526 12885 catalog_manager.cc:4841] TS a1409fec04944e3f891b9130818254c8 (127.10.205.66:41431): tablet ab773d2d847043e786841d09a74f49c8 (table test-table [id=c176650c54db4a7593fe3403f906f266]) successfully deleted
Aug 09 06:52:10 dist-test-slave-0b58 krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258330, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 06:52:10 dist-test-slave-0b58 krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258330, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:10.709328 13535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:10.693684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54094 (local address 127.10.205.126:39229)
0809 06:52:10.694329 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:10.694338 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:10.694369 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:52:10.694669 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:10.694675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:10.694768 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:10.694898 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:10.696925 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:10.697977 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:10.699322 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:10.699896 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:10.699997 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:10.703990 (+ 3993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:10.703997 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:10.704002 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:10.704045 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:10.707012 (+ 2967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:10.707643 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:10.707647 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:10.707649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:10.707773 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:10.708085 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:10.708088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:10.708090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:10.708459 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:10.708667 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:10.708875 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 06:52:10.709046 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":318,"threads_started":1}
I20260809 06:52:10.712880 12898 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54094:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:52:10.713470 12898 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:10.719992 13040 tablet_service.cc:1467] Processing CreateTablet for tablet 5ea1bbad5e7a4fd58b9fff466734a536 (DEFAULT_TABLE table=test-table [id=a33e24adba764955be1d903e0db4bc8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:10.720151 13183 tablet_service.cc:1467] Processing CreateTablet for tablet 5ea1bbad5e7a4fd58b9fff466734a536 (DEFAULT_TABLE table=test-table [id=a33e24adba764955be1d903e0db4bc8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:10.720544 13040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ea1bbad5e7a4fd58b9fff466734a536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:10.720644 13183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ea1bbad5e7a4fd58b9fff466734a536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:10.720722 13328 tablet_service.cc:1467] Processing CreateTablet for tablet 5ea1bbad5e7a4fd58b9fff466734a536 (DEFAULT_TABLE table=test-table [id=a33e24adba764955be1d903e0db4bc8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:10.721150 13328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ea1bbad5e7a4fd58b9fff466734a536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:10.725802 13536 tablet_bootstrap.cc:492] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8: Bootstrap starting.
I20260809 06:52:10.728215 13538 tablet_bootstrap.cc:492] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d: Bootstrap starting.
I20260809 06:52:10.727890 13536 tablet_bootstrap.cc:654] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:10.730273 13538 tablet_bootstrap.cc:654] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:10.732250 13536 tablet_bootstrap.cc:492] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8: No bootstrap required, opened a new log
I20260809 06:52:10.732438 13536 ts_tablet_manager.cc:1397] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
I20260809 06:52:10.732656 13537 tablet_bootstrap.cc:492] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa: Bootstrap starting.
I20260809 06:52:10.732895 13538 tablet_bootstrap.cc:492] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d: No bootstrap required, opened a new log
I20260809 06:52:10.733042 13538 ts_tablet_manager.cc:1397] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 06:52:10.733314 13536 raft_consensus.cc:348] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.733561 13536 raft_consensus.cc:374] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:10.733657 13536 raft_consensus.cc:729] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1409fec04944e3f891b9130818254c8, State: Initialized, Role: FOLLOWER
I20260809 06:52:10.733906 13536 consensus_queue.cc:260] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.733942 13538 raft_consensus.cc:348] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.734473 13537 tablet_bootstrap.cc:654] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:10.734511 13536 ts_tablet_manager.cc:1428] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 06:52:10.734673 13538 raft_consensus.cc:374] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:10.734807 13538 raft_consensus.cc:729] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa8374afa1f40599d442ced5df6904d, State: Initialized, Role: FOLLOWER
I20260809 06:52:10.735062 13538 consensus_queue.cc:260] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.735970 13538 ts_tablet_manager.cc:1428] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:10.737579 13537 tablet_bootstrap.cc:492] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa: No bootstrap required, opened a new log
I20260809 06:52:10.738070 13537 ts_tablet_manager.cc:1397] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260809 06:52:10.738914 13537 raft_consensus.cc:348] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.739254 13537 raft_consensus.cc:374] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:10.739379 13537 raft_consensus.cc:729] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725534b1392246f4a0e87123c504fcaa, State: Initialized, Role: FOLLOWER
I20260809 06:52:10.739624 13537 consensus_queue.cc:260] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.740202 13537 ts_tablet_manager.cc:1428] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 06:52:10.803428 13514 raft_consensus.cc:482] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:10.803682 13514 raft_consensus.cc:504] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.804526 13514 leader_election.cc:288] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 725534b1392246f4a0e87123c504fcaa (127.10.205.65:43087), 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037)
I20260809 06:52:10.805142 13061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ea1bbad5e7a4fd58b9fff466734a536" candidate_uuid: "a1409fec04944e3f891b9130818254c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725534b1392246f4a0e87123c504fcaa" is_pre_election: true
I20260809 06:52:10.805240 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ea1bbad5e7a4fd58b9fff466734a536" candidate_uuid: "a1409fec04944e3f891b9130818254c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa8374afa1f40599d442ced5df6904d" is_pre_election: true
I20260809 06:52:10.805454 13061 raft_consensus.cc:2454] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1409fec04944e3f891b9130818254c8 in term 0.
I20260809 06:52:10.805521 13353 raft_consensus.cc:2454] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1409fec04944e3f891b9130818254c8 in term 0.
I20260809 06:52:10.806030 13135 leader_election.cc:302] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1fa8374afa1f40599d442ced5df6904d, 725534b1392246f4a0e87123c504fcaa, a1409fec04944e3f891b9130818254c8; no voters:
I20260809 06:52:10.806365 13514 raft_consensus.cc:2781] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:10.806471 13514 raft_consensus.cc:482] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:10.806581 13514 raft_consensus.cc:3037] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:10.809374 13514 raft_consensus.cc:504] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.809934 13514 leader_election.cc:288] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [CANDIDATE]: Term 1 election: Requested vote from peers 725534b1392246f4a0e87123c504fcaa (127.10.205.65:43087), 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037)
I20260809 06:52:10.810496 13061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ea1bbad5e7a4fd58b9fff466734a536" candidate_uuid: "a1409fec04944e3f891b9130818254c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "725534b1392246f4a0e87123c504fcaa"
I20260809 06:52:10.810746 13061 raft_consensus.cc:3037] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:10.810770 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ea1bbad5e7a4fd58b9fff466734a536" candidate_uuid: "a1409fec04944e3f891b9130818254c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa8374afa1f40599d442ced5df6904d"
I20260809 06:52:10.811030 13353 raft_consensus.cc:3037] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:10.812971 13061 raft_consensus.cc:2454] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1409fec04944e3f891b9130818254c8 in term 1.
I20260809 06:52:10.813252 13353 raft_consensus.cc:2454] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1409fec04944e3f891b9130818254c8 in term 1.
I20260809 06:52:10.813396 13135 leader_election.cc:302] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725534b1392246f4a0e87123c504fcaa, a1409fec04944e3f891b9130818254c8; no voters:
I20260809 06:52:10.813777 13514 raft_consensus.cc:2781] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:10.813966 13514 raft_consensus.cc:686] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 1 LEADER]: Becoming Leader. State: Replica: a1409fec04944e3f891b9130818254c8, State: Running, Role: LEADER
I20260809 06:52:10.814270 13514 consensus_queue.cc:237] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.817013 12898 catalog_manager.cc:5495] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1409fec04944e3f891b9130818254c8 (127.10.205.66). New cstate: current_term: 1 leader_uuid: "a1409fec04944e3f891b9130818254c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } health_report { overall_health: UNKNOWN } } }
I20260809 06:52:10.842598 13547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:10.837468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52506 (local address 127.10.205.66:41431)
0809 06:52:10.838021 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:10.838026 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:10.838046 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:52:10.838098 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:10.838101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:10.838161 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:10.838243 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:10.838576 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:10.839603 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:10.840922 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:10.841342 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:10.841440 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:10.841862 (+ 422us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:10.841969 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:10.842039 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:10.842174 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 06:52:10.842236 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":300,"threads_started":1}
I20260809 06:52:10.851574 13353 raft_consensus.cc:1261] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Refusing update from remote peer a1409fec04944e3f891b9130818254c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:10.851781 13061 raft_consensus.cc:1261] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Refusing update from remote peer a1409fec04944e3f891b9130818254c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:10.852316 13517 consensus_queue.cc:1035] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:10.852664 13514 consensus_queue.cc:1035] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:10.895784 12901 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:10.896049 12901 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:10.899081 12901 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b: Sending DeleteTablet for 3 replicas of tablet 5ea1bbad5e7a4fd58b9fff466734a536
I20260809 06:52:10.899946 13183 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ea1bbad5e7a4fd58b9fff466734a536 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:10 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:52748
I20260809 06:52:10.900031 13328 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ea1bbad5e7a4fd58b9fff466734a536 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:10 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:56946
I20260809 06:52:10.900233 13527 tablet_replica.cc:330] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8: stopping tablet replica
I20260809 06:52:10.900357 13526 tablet_replica.cc:330] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d: stopping tablet replica
I20260809 06:52:10.900475 13527 raft_consensus.cc:2229] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:10.900565 13526 raft_consensus.cc:2229] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:10.900777 13526 raft_consensus.cc:2258] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:10.900854 13527 raft_consensus.cc:2258] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:10.901347 13040 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ea1bbad5e7a4fd58b9fff466734a536 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:10 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:37570
I20260809 06:52:10.901180 12901 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54094:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 06:52:10.901678 13525 tablet_replica.cc:330] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa: stopping tablet replica
W20260809 06:52:10.901856 12901 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:10.901902 13525 raft_consensus.cc:2229] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:10.901971 13527 ts_tablet_manager.cc:1905] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:10.902097 13525 raft_consensus.cc:2258] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:10.902309 13526 ts_tablet_manager.cc:1905] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:10.908427 13526 ts_tablet_manager.cc:1918] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:52:10.908600 13526 log.cc:1196] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/5ea1bbad5e7a4fd58b9fff466734a536
I20260809 06:52:10.908617 13527 ts_tablet_manager.cc:1918] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:52:10.908775 13527 log.cc:1196] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/5ea1bbad5e7a4fd58b9fff466734a536
I20260809 06:52:10.909066 13526 ts_tablet_manager.cc:1939] T 5ea1bbad5e7a4fd58b9fff466734a536 P 1fa8374afa1f40599d442ced5df6904d: Deleting consensus metadata
I20260809 06:52:10.909212 13527 ts_tablet_manager.cc:1939] T 5ea1bbad5e7a4fd58b9fff466734a536 P a1409fec04944e3f891b9130818254c8: Deleting consensus metadata
I20260809 06:52:10.909125 13040 tablet_service.cc:1467] Processing CreateTablet for tablet dfb5cf338bab4071b0f33574ebffaad6 (DEFAULT_TABLE table=test-table [id=9036d306d43b43719e116449aa7c8810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:10.909586 13040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfb5cf338bab4071b0f33574ebffaad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:10.909770 13183 tablet_service.cc:1467] Processing CreateTablet for tablet dfb5cf338bab4071b0f33574ebffaad6 (DEFAULT_TABLE table=test-table [id=9036d306d43b43719e116449aa7c8810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:10.910197 13183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfb5cf338bab4071b0f33574ebffaad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:10.910338 12885 catalog_manager.cc:4841] TS a1409fec04944e3f891b9130818254c8 (127.10.205.66:41431): tablet 5ea1bbad5e7a4fd58b9fff466734a536 (table test-table [id=a33e24adba764955be1d903e0db4bc8f]) successfully deleted
I20260809 06:52:10.910813 13328 tablet_service.cc:1467] Processing CreateTablet for tablet dfb5cf338bab4071b0f33574ebffaad6 (DEFAULT_TABLE table=test-table [id=9036d306d43b43719e116449aa7c8810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:10.911173 13328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfb5cf338bab4071b0f33574ebffaad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:10.914379 13525 ts_tablet_manager.cc:1905] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:10.915112 13537 tablet_bootstrap.cc:492] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa: Bootstrap starting.
I20260809 06:52:10.916389 12884 catalog_manager.cc:4841] TS 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037): tablet 5ea1bbad5e7a4fd58b9fff466734a536 (table test-table [id=a33e24adba764955be1d903e0db4bc8f]) successfully deleted
I20260809 06:52:10.916922 13536 tablet_bootstrap.cc:492] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8: Bootstrap starting.
I20260809 06:52:10.917125 13537 tablet_bootstrap.cc:654] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:10.918617 13536 tablet_bootstrap.cc:654] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:10.920957 13538 tablet_bootstrap.cc:492] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d: Bootstrap starting.
I20260809 06:52:10.921468 13537 tablet_bootstrap.cc:492] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa: No bootstrap required, opened a new log
I20260809 06:52:10.921702 13537 ts_tablet_manager.cc:1397] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s
I20260809 06:52:10.922605 13536 tablet_bootstrap.cc:492] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8: No bootstrap required, opened a new log
I20260809 06:52:10.922529 13537 raft_consensus.cc:348] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.922695 13538 tablet_bootstrap.cc:654] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:10.922811 13537 raft_consensus.cc:374] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:10.922920 13537 raft_consensus.cc:729] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725534b1392246f4a0e87123c504fcaa, State: Initialized, Role: FOLLOWER
I20260809 06:52:10.922926 13536 ts_tablet_manager.cc:1397] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260809 06:52:10.923199 13537 consensus_queue.cc:260] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.923439 13525 ts_tablet_manager.cc:1918] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:52:10.923604 13525 log.cc:1196] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/5ea1bbad5e7a4fd58b9fff466734a536
I20260809 06:52:10.923908 13537 ts_tablet_manager.cc:1428] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 06:52:10.924109 13525 ts_tablet_manager.cc:1939] T 5ea1bbad5e7a4fd58b9fff466734a536 P 725534b1392246f4a0e87123c504fcaa: Deleting consensus metadata
I20260809 06:52:10.924104 13536 raft_consensus.cc:348] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.924547 13536 raft_consensus.cc:374] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:10.924682 13536 raft_consensus.cc:729] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1409fec04944e3f891b9130818254c8, State: Initialized, Role: FOLLOWER
I20260809 06:52:10.925192 12885 catalog_manager.cc:4841] TS 725534b1392246f4a0e87123c504fcaa (127.10.205.65:43087): tablet 5ea1bbad5e7a4fd58b9fff466734a536 (table test-table [id=a33e24adba764955be1d903e0db4bc8f]) successfully deleted
I20260809 06:52:10.924985 13536 consensus_queue.cc:260] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.926640 13536 ts_tablet_manager.cc:1428] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 06:52:10.928084 13538 tablet_bootstrap.cc:492] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d: No bootstrap required, opened a new log
I20260809 06:52:10.928318 13538 ts_tablet_manager.cc:1397] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260809 06:52:10.929138 13538 raft_consensus.cc:348] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.929402 13538 raft_consensus.cc:374] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:10.929486 13538 raft_consensus.cc:729] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa8374afa1f40599d442ced5df6904d, State: Initialized, Role: FOLLOWER
I20260809 06:52:10.929780 13538 consensus_queue.cc:260] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:10.930337 13538 ts_tablet_manager.cc:1428] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 06:52:11.119333 13544 raft_consensus.cc:482] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:11.119586 13544 raft_consensus.cc:504] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:11.120451 13544 leader_election.cc:288] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1409fec04944e3f891b9130818254c8 (127.10.205.66:41431), 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037)
I20260809 06:52:11.121124 13203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfb5cf338bab4071b0f33574ebffaad6" candidate_uuid: "725534b1392246f4a0e87123c504fcaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1409fec04944e3f891b9130818254c8" is_pre_election: true
I20260809 06:52:11.121218 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfb5cf338bab4071b0f33574ebffaad6" candidate_uuid: "725534b1392246f4a0e87123c504fcaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa8374afa1f40599d442ced5df6904d" is_pre_election: true
I20260809 06:52:11.121392 13203 raft_consensus.cc:2454] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725534b1392246f4a0e87123c504fcaa in term 0.
I20260809 06:52:11.121542 13353 raft_consensus.cc:2454] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725534b1392246f4a0e87123c504fcaa in term 0.
I20260809 06:52:11.121969 12992 leader_election.cc:302] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725534b1392246f4a0e87123c504fcaa, a1409fec04944e3f891b9130818254c8; no voters:
I20260809 06:52:11.122251 13544 raft_consensus.cc:2781] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:11.122398 13544 raft_consensus.cc:482] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:11.122514 13544 raft_consensus.cc:3037] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:11.124667 13544 raft_consensus.cc:504] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:11.125325 13544 leader_election.cc:288] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [CANDIDATE]: Term 1 election: Requested vote from peers a1409fec04944e3f891b9130818254c8 (127.10.205.66:41431), 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037)
I20260809 06:52:11.125809 13203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfb5cf338bab4071b0f33574ebffaad6" candidate_uuid: "725534b1392246f4a0e87123c504fcaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1409fec04944e3f891b9130818254c8"
I20260809 06:52:11.125905 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfb5cf338bab4071b0f33574ebffaad6" candidate_uuid: "725534b1392246f4a0e87123c504fcaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa8374afa1f40599d442ced5df6904d"
I20260809 06:52:11.126058 13203 raft_consensus.cc:3037] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:11.126103 13353 raft_consensus.cc:3037] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:11.129182 13203 raft_consensus.cc:2454] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725534b1392246f4a0e87123c504fcaa in term 1.
I20260809 06:52:11.129184 13353 raft_consensus.cc:2454] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725534b1392246f4a0e87123c504fcaa in term 1.
I20260809 06:52:11.129683 12991 leader_election.cc:302] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1fa8374afa1f40599d442ced5df6904d, 725534b1392246f4a0e87123c504fcaa, a1409fec04944e3f891b9130818254c8; no voters:
I20260809 06:52:11.130048 13544 raft_consensus.cc:2781] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:11.130225 13544 raft_consensus.cc:686] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 1 LEADER]: Becoming Leader. State: Replica: 725534b1392246f4a0e87123c504fcaa, State: Running, Role: LEADER
I20260809 06:52:11.130534 13544 consensus_queue.cc:237] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } }
I20260809 06:52:11.133201 12901 catalog_manager.cc:5495] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 725534b1392246f4a0e87123c504fcaa (127.10.205.65). New cstate: current_term: 1 leader_uuid: "725534b1392246f4a0e87123c504fcaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725534b1392246f4a0e87123c504fcaa" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 } health_report { overall_health: UNKNOWN } } }
I20260809 06:52:11.177013 13557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:11.171173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38820 (local address 127.10.205.65:43087)
0809 06:52:11.171758 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:11.171762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:11.171779 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:52:11.171830 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:11.171834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:11.171891 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:11.172002 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:11.172481 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:11.173239 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:11.175081 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:11.175531 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:11.175671 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:11.176151 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:11.176315 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:11.176422 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:11.176584 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 06:52:11.176662 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":348,"threads_started":1}
I20260809 06:52:11.186070 13353 raft_consensus.cc:1261] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Refusing update from remote peer 725534b1392246f4a0e87123c504fcaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:11.186030 13203 raft_consensus.cc:1261] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Refusing update from remote peer 725534b1392246f4a0e87123c504fcaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:11.186659 13505 consensus_queue.cc:1035] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fa8374afa1f40599d442ced5df6904d" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:11.187017 13544 consensus_queue.cc:1035] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1409fec04944e3f891b9130818254c8" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 06:52:11.206415 13503 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 06:52:12.787604 12901 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:12.787832 12901 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:12.792210 12901 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07b677dc6edb4eb38530c0e9b0bae75b: Sending DeleteTablet for 3 replicas of tablet dfb5cf338bab4071b0f33574ebffaad6
I20260809 06:52:12.793043 13039 tablet_service.cc:1514] Processing DeleteTablet for tablet dfb5cf338bab4071b0f33574ebffaad6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:12 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:37570
I20260809 06:52:12.793223 13183 tablet_service.cc:1514] Processing DeleteTablet for tablet dfb5cf338bab4071b0f33574ebffaad6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:12 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:52748
I20260809 06:52:12.793267 13328 tablet_service.cc:1514] Processing DeleteTablet for tablet dfb5cf338bab4071b0f33574ebffaad6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:12 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:56946
I20260809 06:52:12.793947 13585 tablet_replica.cc:330] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8: stopping tablet replica
I20260809 06:52:12.794148 13585 raft_consensus.cc:2229] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:12.794445 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 12972
I20260809 06:52:12.794523 13585 raft_consensus.cc:2258] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:12.795718 13585 ts_tablet_manager.cc:1905] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:12.800772 13584 tablet_replica.cc:330] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa: stopping tablet replica
I20260809 06:52:12.801090 13584 raft_consensus.cc:2229] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:12.801577 13584 raft_consensus.cc:2258] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:12.802312 13587 tablet_replica.cc:330] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d: stopping tablet replica
I20260809 06:52:12.802541 13587 raft_consensus.cc:2229] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:12.802891 13587 raft_consensus.cc:2258] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:12.803082 13584 ts_tablet_manager.cc:1905] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:12.803889 13585 ts_tablet_manager.cc:1918] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 06:52:12.804082 13585 log.cc:1196] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/dfb5cf338bab4071b0f33574ebffaad6
I20260809 06:52:12.804316 13587 ts_tablet_manager.cc:1905] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:12.804634 13585 ts_tablet_manager.cc:1939] T dfb5cf338bab4071b0f33574ebffaad6 P a1409fec04944e3f891b9130818254c8: Deleting consensus metadata
I20260809 06:52:12.805869 12885 catalog_manager.cc:4841] TS a1409fec04944e3f891b9130818254c8 (127.10.205.66:41431): tablet dfb5cf338bab4071b0f33574ebffaad6 (table test-table [id=9036d306d43b43719e116449aa7c8810]) successfully deleted
I20260809 06:52:12.809558 13584 ts_tablet_manager.cc:1918] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 06:52:12.809712 13584 log.cc:1196] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/dfb5cf338bab4071b0f33574ebffaad6
I20260809 06:52:12.809890 13587 ts_tablet_manager.cc:1918] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 06:52:12.810025 13587 log.cc:1196] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/dfb5cf338bab4071b0f33574ebffaad6
I20260809 06:52:12.810209 13584 ts_tablet_manager.cc:1939] T dfb5cf338bab4071b0f33574ebffaad6 P 725534b1392246f4a0e87123c504fcaa: Deleting consensus metadata
I20260809 06:52:12.810499 13587 ts_tablet_manager.cc:1939] T dfb5cf338bab4071b0f33574ebffaad6 P 1fa8374afa1f40599d442ced5df6904d: Deleting consensus metadata
I20260809 06:52:12.811247 12885 catalog_manager.cc:4841] TS 725534b1392246f4a0e87123c504fcaa (127.10.205.65:43087): tablet dfb5cf338bab4071b0f33574ebffaad6 (table test-table [id=9036d306d43b43719e116449aa7c8810]) successfully deleted
I20260809 06:52:12.811501 12884 catalog_manager.cc:4841] TS 1fa8374afa1f40599d442ced5df6904d (127.10.205.67:37037): tablet dfb5cf338bab4071b0f33574ebffaad6 (table test-table [id=9036d306d43b43719e116449aa7c8810]) successfully deleted
Aug 09 06:52:12 dist-test-slave-0b58 krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258330, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:52:12.821081 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:12.796555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38822 (local address 127.10.205.65:43087)
0809 06:52:12.797229 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:12.797238 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:12.801035 (+ 3797us) server_negotiation.cc:407] Connection header received
0809 06:52:12.801341 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:12.801345 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:12.801423 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:12.801512 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:12.803522 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:12.804721 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:12.806614 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:12.807328 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:12.807462 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:12.815133 (+ 7671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:12.815152 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:12.815169 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:12.815202 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:12.818175 (+ 2973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:12.818848 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:12.818862 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:12.818864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:12.818993 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:12.819380 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:12.819385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:12.819388 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:12.819777 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:12.820089 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:12.820415 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 06:52:12.820664 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":442,"threads_started":1}
W20260809 06:52:12.821947 13108 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38822
W20260809 06:52:12.822582 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 12972: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:52:12.822778 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 12972
I20260809 06:52:12.852793 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 13117
Aug 09 06:52:12 dist-test-slave-0b58 krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258330, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:52:12.868083 13591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:12.853662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52508 (local address 127.10.205.66:41431)
0809 06:52:12.854212 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:12.854216 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:12.854233 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:52:12.854294 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:12.854298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:12.854358 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:12.854447 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:12.855758 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:12.856641 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:12.857882 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:12.858260 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:12.858353 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:12.862663 (+ 4310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:12.862678 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:12.862695 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:12.862734 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:12.865712 (+ 2978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:12.866361 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:12.866368 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:12.866370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:12.866512 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:12.866810 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:12.866813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:12.866815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:12.867175 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:12.867410 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:12.867616 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 06:52:12.867783 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":314,"threads_started":1}
W20260809 06:52:12.869006 13251 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52508
W20260809 06:52:12.869674 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 13117: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:52:12.869833 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 13117
I20260809 06:52:12.895622 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 13261
Aug 09 06:52:12 dist-test-slave-0b58 krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258330, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:52:12.911232 13592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:12.896501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47192 (local address 127.10.205.67:37037)
0809 06:52:12.897074 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:12.897079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:12.897096 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:52:12.897152 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:12.897156 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:12.897217 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:12.897321 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:12.898627 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:12.899363 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:12.900657 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:12.901071 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:12.901173 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:12.905453 (+ 4280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:12.905471 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:12.905487 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:12.905521 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:12.908423 (+ 2902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:12.909306 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:12.909316 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:12.909319 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:12.909525 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:12.909857 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:12.909860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:12.909862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:12.910201 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:12.910448 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:12.910676 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 06:52:12.910849 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":314,"threads_started":1}
W20260809 06:52:12.911955 13403 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47192
W20260809 06:52:12.912688 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 13261: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:52:12.912875 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 13261
I20260809 06:52:12.933368 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 12867
I20260809 06:52:12.934728 12941 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:13.053755 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 12867
2026-08-09T06:52:13Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8542 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:52:13 dist-test-slave-0b58 krb5kdc[13596](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:52:13 dist-test-slave-0b58 krb5kdc[13596](info): set up 2 sockets
Aug 09 06:52:13 dist-test-slave-0b58 krb5kdc[13596](info): commencing operation
krb5kdc: starting...
W20260809 06:52:14.192368 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:52:14 dist-test-slave-0b58 krb5kdc[13596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:52:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:52:14.409889 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:42741
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:42741
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:14.743980 13610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:14.744387 13610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:14.744624 13610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:14.752082 13610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:14.752230 13610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:14.752390 13610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:14.752496 13610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:14.752584 13610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:14.762744 13610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:42741
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:42741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:14.764161 13610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:14.765532 13610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:14.778030 13618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:14.778090 13616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:14.778493 13610 server_base.cc:1034] running on GCE node
W20260809 06:52:14.778178 13615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:14.779474 13610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:14.780936 13610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:14.782140 13610 hybrid_clock.cc:648] HybridClock initialized: now 1786258334782076 us; error 48 us; skew 500 ppm
I20260809 06:52:14.782500 13610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:14 dist-test-slave-0b58 krb5kdc[13596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258334, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:14.785647 13610 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:52:14.787114 13610 webserver.cc:460] Webserver started at http://127.10.205.126:44269/ using document root <none> and password file <none>
I20260809 06:52:14.787806 13610 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:14.787954 13610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:14.788322 13610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:14.791275 13610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "3546b17dabb64eecb94d51c9f32fb8e2"
format_stamp: "Formatted at 2026-08-09 06:52:14 on dist-test-slave-0b58"
server_key: "ffc38dd6ec6b7e9b2ddb50ad9ee7bb5c"
server_key_iv: "f27acaafcbf3d2503d2a9b0300243a3e"
server_key_version: "encryptionkey@0"
I20260809 06:52:14.792054 13610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "3546b17dabb64eecb94d51c9f32fb8e2"
format_stamp: "Formatted at 2026-08-09 06:52:14 on dist-test-slave-0b58"
server_key: "ffc38dd6ec6b7e9b2ddb50ad9ee7bb5c"
server_key_iv: "f27acaafcbf3d2503d2a9b0300243a3e"
server_key_version: "encryptionkey@0"
I20260809 06:52:14.797497 13610 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 06:52:14.800928 13625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:14.802270 13610 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:52:14.802459 13610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "3546b17dabb64eecb94d51c9f32fb8e2"
format_stamp: "Formatted at 2026-08-09 06:52:14 on dist-test-slave-0b58"
server_key: "ffc38dd6ec6b7e9b2ddb50ad9ee7bb5c"
server_key_iv: "f27acaafcbf3d2503d2a9b0300243a3e"
server_key_version: "encryptionkey@0"
I20260809 06:52:14.802652 13610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:14.815834 13610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:14.819831 13610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:14.820132 13610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:14.839147 13610 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:42741
I20260809 06:52:14.839200 13676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:42741 every 8 connection(s)
I20260809 06:52:14.840642 13610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:14.844543 13677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:14.849828 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 13610
I20260809 06:52:14.850085 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:14.850713 11061 external_mini_cluster.cc:1428] Setting key d5e9a7fcc64154b107f17a87b4cd9176
I20260809 06:52:14.855634 13677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2: Bootstrap starting.
I20260809 06:52:14.859429 13677 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:14.860791 13677 log.cc:824] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:14.864176 13677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2: No bootstrap required, opened a new log
Aug 09 06:52:14 dist-test-slave-0b58 krb5kdc[13596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:14.875098 13677 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3546b17dabb64eecb94d51c9f32fb8e2" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42741 } }
I20260809 06:52:14.875602 13677 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:14.875722 13677 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3546b17dabb64eecb94d51c9f32fb8e2, State: Initialized, Role: FOLLOWER
I20260809 06:52:14.876516 13680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:14.852781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40558 (local address 127.10.205.126:42741)
0809 06:52:14.853776 (+ 995us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:14.853789 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:14.853831 (+ 42us) server_negotiation.cc:407] Connection header received
0809 06:52:14.855562 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:14.855584 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:14.856024 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:14.856423 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:14.858280 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:14.859592 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:14.861525 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:14.862499 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:14.862639 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:14.867474 (+ 4835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:14.867484 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:14.867503 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:14.867548 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:14.871706 (+ 4158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:14.872489 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:14.872498 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:14.872508 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:14.872744 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:14.873110 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:14.873115 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:14.873118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:14.873913 (+ 795us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:14.874222 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:14.874568 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 06:52:14.875027 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":758,"thread_start_us":516,"threads_started":1}
I20260809 06:52:14.876417 13677 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3546b17dabb64eecb94d51c9f32fb8e2" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42741 } }
I20260809 06:52:14.876701 13677 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:14.876856 13677 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:14.877048 13677 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:14.879886 13677 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3546b17dabb64eecb94d51c9f32fb8e2" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42741 } }
I20260809 06:52:14.880424 13677 leader_election.cc:302] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3546b17dabb64eecb94d51c9f32fb8e2; no voters:
I20260809 06:52:14.880959 13677 leader_election.cc:288] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:14.881106 13682 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:14.881820 13682 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [term 1 LEADER]: Becoming Leader. State: Replica: 3546b17dabb64eecb94d51c9f32fb8e2, State: Running, Role: LEADER
I20260809 06:52:14.882344 13682 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3546b17dabb64eecb94d51c9f32fb8e2" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42741 } }
I20260809 06:52:14.883092 13677 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:14.885226 13683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3546b17dabb64eecb94d51c9f32fb8e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3546b17dabb64eecb94d51c9f32fb8e2" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42741 } } }
I20260809 06:52:14.885576 13683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:14.886466 13687 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:14.886315 13684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3546b17dabb64eecb94d51c9f32fb8e2. Latest consensus state: current_term: 1 leader_uuid: "3546b17dabb64eecb94d51c9f32fb8e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3546b17dabb64eecb94d51c9f32fb8e2" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42741 } } }
I20260809 06:52:14.886719 13684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:14.892859 13687 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:14.902212 13687 catalog_manager.cc:1347] Generated new cluster ID: 85f124720f1342deb01edc693cb9ccc5
I20260809 06:52:14.902340 13687 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:14.929730 13687 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:14.931147 13687 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:14.941948 13687 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3546b17dabb64eecb94d51c9f32fb8e2: Generated new TSK 0
I20260809 06:52:14.942837 13687 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:52:14.999615 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:42741
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:15.334697 13706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:15.334995 13706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:15.335090 13706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:15.342629 13706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:15.342743 13706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:15.342862 13706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:52:15.352814 13706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:42741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:15.354120 13706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:15.355386 13706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:15.369133 13715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:15.369180 13713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:15.369223 13712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:15.369988 13706 server_base.cc:1034] running on GCE node
I20260809 06:52:15.370739 13706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:15.371716 13706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:15.372958 13706 hybrid_clock.cc:648] HybridClock initialized: now 1786258335372899 us; error 65 us; skew 500 ppm
I20260809 06:52:15.373304 13706 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:15 dist-test-slave-0b58 krb5kdc[13596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258335, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:15.376590 13706 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:52:15.378095 13706 webserver.cc:460] Webserver started at http://127.10.205.65:45097/ using document root <none> and password file <none>
I20260809 06:52:15.378815 13706 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:15.378978 13706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:15.379288 13706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:15.382344 13706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "6e298f44a761492a8ff8639b319ed07a"
format_stamp: "Formatted at 2026-08-09 06:52:15 on dist-test-slave-0b58"
server_key: "d4905a60b4949bfc93bb06d7a98ce6fa"
server_key_iv: "3a11f03899c91dcac14ec4c367dc3fe5"
server_key_version: "encryptionkey@0"
I20260809 06:52:15.383235 13706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "6e298f44a761492a8ff8639b319ed07a"
format_stamp: "Formatted at 2026-08-09 06:52:15 on dist-test-slave-0b58"
server_key: "d4905a60b4949bfc93bb06d7a98ce6fa"
server_key_iv: "3a11f03899c91dcac14ec4c367dc3fe5"
server_key_version: "encryptionkey@0"
I20260809 06:52:15.388461 13706 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 06:52:15.391886 13722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:15.393221 13706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:15.393414 13706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "6e298f44a761492a8ff8639b319ed07a"
format_stamp: "Formatted at 2026-08-09 06:52:15 on dist-test-slave-0b58"
server_key: "d4905a60b4949bfc93bb06d7a98ce6fa"
server_key_iv: "3a11f03899c91dcac14ec4c367dc3fe5"
server_key_version: "encryptionkey@0"
I20260809 06:52:15.393632 13706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:15.406246 13706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:15.410288 13706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:15.410596 13706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:15.411630 13706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:15.413048 13706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:15.413152 13706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:15.413311 13706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:15.413386 13706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:15.447816 13706 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:37059
I20260809 06:52:15.447861 13839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:37059 every 8 connection(s)
I20260809 06:52:15.449216 13706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:52:15.452381 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 13706
I20260809 06:52:15.452630 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:52:15.453513 11061 external_mini_cluster.cc:1428] Setting key feba704a9ebeb1d6b9912cfd83a6ccd0
Aug 09 06:52:15 dist-test-slave-0b58 krb5kdc[13596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258335, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:15.471096 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:15.451819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:55449 (local address 127.10.205.126:42741)
0809 06:52:15.452352 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:15.452356 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:15.453480 (+ 1124us) server_negotiation.cc:407] Connection header received
0809 06:52:15.455616 (+ 2136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:15.455622 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:15.455704 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:15.455840 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:15.457420 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:15.458620 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:15.460193 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:15.460977 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:15.461133 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:15.464989 (+ 3856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:15.464995 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:15.464998 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:15.465032 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:15.467672 (+ 2640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:15.468679 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:15.468683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:15.468685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:15.468820 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:15.469333 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:15.469336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:15.469338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:15.469592 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:15.469715 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:15.470644 (+ 929us) server_negotiation.cc:299] Negotiation successful
0809 06:52:15.470830 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":256,"threads_started":1}
I20260809 06:52:15.472770 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:15.452513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:42741 (local address 127.10.205.65:55449)
0809 06:52:15.453314 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:15.453360 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:15.455262 (+ 1902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:15.456026 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:15.456034 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:15.456648 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:15.457230 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:15.457247 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:15.458778 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:15.458782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:15.460036 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:15.460047 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:15.461194 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:15.461198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:15.461402 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:15.462125 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:15.462148 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:15.464754 (+ 2606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:15.467836 (+ 3082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:15.467848 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:15.467868 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:15.468558 (+ 690us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:15.468938 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:15.468946 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:15.468952 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:15.469218 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:15.469721 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:15.469732 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:15.470218 (+ 486us) client_negotiation.cc:769] Sending connection context
0809 06:52:15.470537 (+ 319us) client_negotiation.cc:240] Negotiation successful
0809 06:52:15.471196 (+ 659us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":344,"threads_started":1}
I20260809 06:52:15.474516 13840 heartbeater.cc:347] Connected to a master server at 127.10.205.126:42741
I20260809 06:52:15.474851 13840 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:15.475580 13840 heartbeater.cc:511] Master 127.10.205.126:42741 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
I20260809 06:52:15.477790 13642 ts_manager.cc:194] Registered new tserver with Master: 6e298f44a761492a8ff8639b319ed07a (127.10.205.65:37059)
I20260809 06:52:15.479374 13642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:55449
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:52:15.507416 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:42741
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:15.840076 13847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:15.840426 13847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:15.840605 13847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:15.848022 13847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:15.848129 13847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:15.848366 13847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:52:15.858323 13847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:42741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:15.859642 13847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:15.861037 13847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:15.874413 13852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:15.874420 13853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:15.874894 13855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:15.875162 13847 server_base.cc:1034] running on GCE node
I20260809 06:52:15.875906 13847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:15.876957 13847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:15.878193 13847 hybrid_clock.cc:648] HybridClock initialized: now 1786258335878148 us; error 59 us; skew 500 ppm
I20260809 06:52:15.878522 13847 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:15 dist-test-slave-0b58 krb5kdc[13596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258335, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:15.881778 13847 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:52:15.883162 13847 webserver.cc:460] Webserver started at http://127.10.205.66:44835/ using document root <none> and password file <none>
I20260809 06:52:15.883893 13847 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:15.883996 13847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:15.884246 13847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:15.887230 13847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "91356476742146598aee7a025b421a60"
format_stamp: "Formatted at 2026-08-09 06:52:15 on dist-test-slave-0b58"
server_key: "567bc9ea34e029b8ec0f872f16bd9ea3"
server_key_iv: "10bd57b614e04e9075d6dcd0fd314e62"
server_key_version: "encryptionkey@0"
I20260809 06:52:15.887984 13847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "91356476742146598aee7a025b421a60"
format_stamp: "Formatted at 2026-08-09 06:52:15 on dist-test-slave-0b58"
server_key: "567bc9ea34e029b8ec0f872f16bd9ea3"
server_key_iv: "10bd57b614e04e9075d6dcd0fd314e62"
server_key_version: "encryptionkey@0"
I20260809 06:52:15.893198 13847 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 06:52:15.896744 13864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:15.898177 13847 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:52:15.898350 13847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "91356476742146598aee7a025b421a60"
format_stamp: "Formatted at 2026-08-09 06:52:15 on dist-test-slave-0b58"
server_key: "567bc9ea34e029b8ec0f872f16bd9ea3"
server_key_iv: "10bd57b614e04e9075d6dcd0fd314e62"
server_key_version: "encryptionkey@0"
I20260809 06:52:15.898591 13847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:15.923836 13847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:15.928052 13847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:15.928398 13847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:15.929438 13847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:15.930857 13847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:15.930963 13847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:15.931114 13847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:15.931188 13847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:15.965425 13847 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:35683
I20260809 06:52:15.965474 13982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:35683 every 8 connection(s)
I20260809 06:52:15.966763 13847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:52:15.969173 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 13847
I20260809 06:52:15.969422 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:52:15.969990 11061 external_mini_cluster.cc:1428] Setting key 7c51e3c01eca0392c625ad053c97b489
Aug 09 06:52:15 dist-test-slave-0b58 krb5kdc[13596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258335, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:15.988951 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:15.969534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:54353 (local address 127.10.205.126:42741)
0809 06:52:15.969722 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:15.969727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:15.971242 (+ 1515us) server_negotiation.cc:407] Connection header received
0809 06:52:15.973234 (+ 1992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:15.973240 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:15.973341 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:15.973454 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:15.975149 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:15.975862 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:15.977472 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:15.977916 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:15.978055 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:15.981752 (+ 3697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:15.981761 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:15.981769 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:15.981824 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:15.985552 (+ 3728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:15.986293 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:15.986301 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:15.986306 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:15.986477 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:15.986897 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:15.986904 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:15.986910 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:15.987282 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:15.987441 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:15.988159 (+ 718us) server_negotiation.cc:299] Negotiation successful
0809 06:52:15.988457 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:52:15.989638 13986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:15.970193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:42741 (local address 127.10.205.66:54353)
0809 06:52:15.971078 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:15.971118 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:15.972975 (+ 1857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:15.973762 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:15.973773 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:15.974409 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:15.974979 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:15.974996 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:15.976026 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:15.976030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:15.977324 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:15.977341 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:15.978152 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:15.978158 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:15.978383 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:15.979076 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:15.979098 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:15.981523 (+ 2425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:15.985689 (+ 4166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:15.985696 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:15.985708 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:15.986151 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:15.986586 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:15.986590 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:15.986592 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:15.986766 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:15.987424 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:15.987429 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:15.987751 (+ 322us) client_negotiation.cc:769] Sending connection context
0809 06:52:15.987986 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 06:52:15.988437 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":355,"threads_started":1}
I20260809 06:52:15.991181 13983 heartbeater.cc:347] Connected to a master server at 127.10.205.126:42741
I20260809 06:52:15.991549 13983 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:15.992518 13983 heartbeater.cc:511] Master 127.10.205.126:42741 requested a full tablet report, sending...
I20260809 06:52:15.994268 13642 ts_manager.cc:194] Registered new tserver with Master: 91356476742146598aee7a025b421a60 (127.10.205.66:35683)
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
I20260809 06:52:15.995273 13642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:54353
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:52:16.023466 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:42741
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:16.356169 13989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:16.356546 13989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:16.356729 13989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:16.364086 13989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:16.364282 13989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:16.364465 13989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:52:16.374224 13989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:42741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:16.375602 13989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:16.376958 13989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:16.390151 13995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:16.390103 13996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:16.390239 13998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:16.391122 13989 server_base.cc:1034] running on GCE node
I20260809 06:52:16.391795 13989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:16.393002 13989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:16.394243 13989 hybrid_clock.cc:648] HybridClock initialized: now 1786258336394185 us; error 66 us; skew 500 ppm
I20260809 06:52:16.394558 13989 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:16 dist-test-slave-0b58 krb5kdc[13596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258336, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:16.398100 13989 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:52:16.399679 13989 webserver.cc:460] Webserver started at http://127.10.205.67:36191/ using document root <none> and password file <none>
I20260809 06:52:16.400473 13989 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:16.400619 13989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:16.400928 13989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:16.404062 13989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "968b4b366a724bc6a793b8d82d54af99"
format_stamp: "Formatted at 2026-08-09 06:52:16 on dist-test-slave-0b58"
server_key: "17b92b3a560016375426874cdb14937c"
server_key_iv: "94ba410eaab1e6269045dcea44389b2d"
server_key_version: "encryptionkey@0"
I20260809 06:52:16.404942 13989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "968b4b366a724bc6a793b8d82d54af99"
format_stamp: "Formatted at 2026-08-09 06:52:16 on dist-test-slave-0b58"
server_key: "17b92b3a560016375426874cdb14937c"
server_key_iv: "94ba410eaab1e6269045dcea44389b2d"
server_key_version: "encryptionkey@0"
I20260809 06:52:16.410262 13989 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:52:16.413882 14007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:16.415182 13989 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:52:16.415375 13989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "968b4b366a724bc6a793b8d82d54af99"
format_stamp: "Formatted at 2026-08-09 06:52:16 on dist-test-slave-0b58"
server_key: "17b92b3a560016375426874cdb14937c"
server_key_iv: "94ba410eaab1e6269045dcea44389b2d"
server_key_version: "encryptionkey@0"
I20260809 06:52:16.415586 13989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:16.432471 13989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:16.436446 13989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:16.436748 13989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:16.437737 13989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:16.439078 13989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:16.439188 13989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:16.439354 13989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:16.439431 13989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:16.474078 13989 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:42909
I20260809 06:52:16.474117 14130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:42909 every 8 connection(s)
I20260809 06:52:16.475392 13989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:52:16.483227 13840 heartbeater.cc:503] Master 127.10.205.126:42741 was elected leader, sending a full tablet report...
I20260809 06:52:16.485186 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 13989
I20260809 06:52:16.485405 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:52:16.485857 11061 external_mini_cluster.cc:1428] Setting key 3d9301107c2a3c1d7e0cad66f13eb956
Aug 09 06:52:16 dist-test-slave-0b58 krb5kdc[13596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258336, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:16.496197 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:16.477956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:52023 (local address 127.10.205.126:42741)
0809 06:52:16.478168 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:16.478174 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:16.479393 (+ 1219us) server_negotiation.cc:407] Connection header received
0809 06:52:16.481261 (+ 1868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:16.481265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:16.481349 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:16.481442 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:16.482947 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:16.483970 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:16.485942 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:16.486402 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:16.486557 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:16.490335 (+ 3778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:16.490340 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:16.490343 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:16.490374 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:16.493095 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:16.493825 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:16.493830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:16.493832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:16.493961 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:16.494418 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:16.494422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:16.494424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:16.494679 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:16.494849 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:16.495574 (+ 725us) server_negotiation.cc:299] Negotiation successful
0809 06:52:16.495849 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:52:16.497283 14133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:16.478505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:42741 (local address 127.10.205.67:52023)
0809 06:52:16.479225 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:16.479264 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:16.481017 (+ 1753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:16.481652 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:16.481660 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:16.482181 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:16.482725 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:16.482807 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:16.484160 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:16.484164 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:16.485802 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:16.485814 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:16.486661 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:16.486668 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:16.486939 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:16.487684 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:16.487727 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:16.490122 (+ 2395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:16.493233 (+ 3111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:16.493243 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:16.493258 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:16.493679 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:16.494078 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:16.494083 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:16.494087 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:16.494279 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:16.494818 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:16.494826 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:16.495185 (+ 359us) client_negotiation.cc:769] Sending connection context
0809 06:52:16.495457 (+ 272us) client_negotiation.cc:240] Negotiation successful
0809 06:52:16.496007 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":281,"threads_started":1}
I20260809 06:52:16.498693 14131 heartbeater.cc:347] Connected to a master server at 127.10.205.126:42741
I20260809 06:52:16.498967 14131 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:16.499748 14131 heartbeater.cc:511] Master 127.10.205.126:42741 requested a full tablet report, sending...
I20260809 06:52:16.501286 13642 ts_manager.cc:194] Registered new tserver with Master: 968b4b366a724bc6a793b8d82d54af99 (127.10.205.67:42909)
I20260809 06:52:16.502161 13642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:52023
I20260809 06:52:16.513412 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 06:52:16.550946 13842 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:52:16.548175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40560 (local address 127.10.205.126:42741)
0809 06:52:16.548466 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:16.548476 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:16.548895 (+ 419us) server_negotiation.cc:407] Connection header received
0809 06:52:16.549124 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:16.549128 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:16.549195 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:16.549313 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:16.550628 (+ 1315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40560: BlockingRecv error: recv got EOF from 127.0.0.1:40560 (error 108)
Metrics: {"server-negotiator.queue_time_us":120}
I20260809 06:52:16.554214 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 13706
W20260809 06:52:16.557114 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 13706: Not authorized: Client connection negotiation failed: client connection to 127.10.205.65:37059: server requires authentication, but client does not have Kerberos credentials available
I20260809 06:52:16.557312 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 13706
I20260809 06:52:16.575434 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 13847
W20260809 06:52:16.578172 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 13847: Not authorized: Client connection negotiation failed: client connection to 127.10.205.66:35683: server requires authentication, but client does not have Kerberos credentials available
I20260809 06:52:16.578369 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 13847
I20260809 06:52:16.596865 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 13989
W20260809 06:52:16.599967 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 13989: Not authorized: Client connection negotiation failed: client connection to 127.10.205.67:42909: server requires authentication, but client does not have Kerberos credentials available
I20260809 06:52:16.600083 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 13989
I20260809 06:52:16.617647 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 13610
I20260809 06:52:16.618863 13672 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:16.725364 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 13610
2026-08-09T06:52:16Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3668 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:52:16 dist-test-slave-0b58 krb5kdc[14150](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:52:16 dist-test-slave-0b58 krb5kdc[14150](info): set up 2 sockets
Aug 09 06:52:16 dist-test-slave-0b58 krb5kdc[14150](info): commencing operation
krb5kdc: starting...
W20260809 06:52:17.851733 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:52:17 dist-test-slave-0b58 krb5kdc[14150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:52:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
W20260809 06:52:18.924605 11061 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.205.126: real 0.889s user 0.000s sys 0.016s
I20260809 06:52:18.925695 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44921
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:44921
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:19.351094 14163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:19.351393 14163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:19.351487 14163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:19.359016 14163 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:19.359136 14163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:19.359184 14163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:19.359243 14163 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:19.359287 14163 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:19.369642 14163 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:44921
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:19.371042 14163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:19.372401 14163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:19.384945 14168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:19.384878 14169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:19.384924 14171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:19.385756 14163 server_base.cc:1034] running on GCE node
I20260809 06:52:19.386531 14163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:19.387957 14163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:19.389161 14163 hybrid_clock.cc:648] HybridClock initialized: now 1786258339389120 us; error 37 us; skew 500 ppm
I20260809 06:52:19.389490 14163 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:19 dist-test-slave-0b58 krb5kdc[14150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258339, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:19.396384 14163 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:52:19.398075 14163 webserver.cc:460] Webserver started at http://127.10.205.126:35247/ using document root <none> and password file <none>
I20260809 06:52:19.398743 14163 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:19.398855 14163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:19.399127 14163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:19.402240 14163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "e25186cf0b7442dba22e46fd88df171e"
format_stamp: "Formatted at 2026-08-09 06:52:19 on dist-test-slave-0b58"
server_key: "008ce1a4044dfc8899df16f5325c7107"
server_key_iv: "77c08562d17d3dd74c43f444c5d1772b"
server_key_version: "encryptionkey@0"
I20260809 06:52:19.403013 14163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "e25186cf0b7442dba22e46fd88df171e"
format_stamp: "Formatted at 2026-08-09 06:52:19 on dist-test-slave-0b58"
server_key: "008ce1a4044dfc8899df16f5325c7107"
server_key_iv: "77c08562d17d3dd74c43f444c5d1772b"
server_key_version: "encryptionkey@0"
I20260809 06:52:19.408492 14163 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 06:52:19.411856 14178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:19.413287 14163 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:19.413431 14163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "e25186cf0b7442dba22e46fd88df171e"
format_stamp: "Formatted at 2026-08-09 06:52:19 on dist-test-slave-0b58"
server_key: "008ce1a4044dfc8899df16f5325c7107"
server_key_iv: "77c08562d17d3dd74c43f444c5d1772b"
server_key_version: "encryptionkey@0"
I20260809 06:52:19.413602 14163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:19.436576 14163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:19.441335 14163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:19.441661 14163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:19.461110 14163 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:44921
I20260809 06:52:19.461145 14231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:44921 every 8 connection(s)
I20260809 06:52:19.462549 14163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:19.466423 14232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:19.469718 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 14163
I20260809 06:52:19.470000 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:19.470860 11061 external_mini_cluster.cc:1428] Setting key 2aa6cb8e2e67d6a2b3f53cdf18765b2d
I20260809 06:52:19.480156 14232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e: Bootstrap starting.
I20260809 06:52:19.484061 14232 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:19.485455 14232 log.cc:824] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:52:19 dist-test-slave-0b58 krb5kdc[14150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:19.488569 14232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e: No bootstrap required, opened a new log
I20260809 06:52:19.496076 14235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:19.472987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33994 (local address 127.10.205.126:44921)
0809 06:52:19.473863 (+ 876us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:19.473876 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:19.473918 (+ 42us) server_negotiation.cc:407] Connection header received
0809 06:52:19.475627 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:19.475648 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:19.476044 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:19.476450 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:19.478633 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:19.480018 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:19.481878 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:19.482580 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:19.482729 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:19.488202 (+ 5473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:19.488211 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:19.488226 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:19.488314 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:19.491570 (+ 3256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:19.492353 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:19.492360 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:19.492371 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:19.492547 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:19.492962 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:19.492966 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:19.492969 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:19.493562 (+ 593us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:19.494008 (+ 446us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:19.494530 (+ 522us) server_negotiation.cc:299] Negotiation successful
0809 06:52:19.494999 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":435,"threads_started":1}
I20260809 06:52:19.497517 14232 raft_consensus.cc:348] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e25186cf0b7442dba22e46fd88df171e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44921 } }
I20260809 06:52:19.497941 14232 raft_consensus.cc:374] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:19.498070 14232 raft_consensus.cc:729] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e25186cf0b7442dba22e46fd88df171e, State: Initialized, Role: FOLLOWER
I20260809 06:52:19.498678 14232 consensus_queue.cc:260] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e25186cf0b7442dba22e46fd88df171e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44921 } }
I20260809 06:52:19.498943 14232 raft_consensus.cc:388] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:19.499089 14232 raft_consensus.cc:482] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:19.499294 14232 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:19.500105 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:52:19.535311 14232 raft_consensus.cc:504] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e25186cf0b7442dba22e46fd88df171e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44921 } }
I20260809 06:52:19.536154 14232 leader_election.cc:302] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e25186cf0b7442dba22e46fd88df171e; no voters:
I20260809 06:52:19.537137 14232 leader_election.cc:288] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:19.537304 14243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:19.544103 14243 raft_consensus.cc:686] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [term 1 LEADER]: Becoming Leader. State: Replica: e25186cf0b7442dba22e46fd88df171e, State: Running, Role: LEADER
I20260809 06:52:19.544884 14232 sys_catalog.cc:564] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:19.544884 14243 consensus_queue.cc:237] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e25186cf0b7442dba22e46fd88df171e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44921 } }
I20260809 06:52:19.551838 14245 sys_catalog.cc:455] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e25186cf0b7442dba22e46fd88df171e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e25186cf0b7442dba22e46fd88df171e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44921 } } }
I20260809 06:52:19.552363 14245 sys_catalog.cc:458] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:19.551457 14246 sys_catalog.cc:455] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e25186cf0b7442dba22e46fd88df171e. Latest consensus state: current_term: 1 leader_uuid: "e25186cf0b7442dba22e46fd88df171e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e25186cf0b7442dba22e46fd88df171e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44921 } } }
I20260809 06:52:19.555255 14235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:19.536546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34010 (local address 127.10.205.126:44921)
0809 06:52:19.536777 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:19.536787 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:19.543956 (+ 7169us) server_negotiation.cc:407] Connection header received
0809 06:52:19.544458 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:19.544464 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:19.544553 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:19.544681 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:19.546097 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:19.547530 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:19.549810 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:19.550538 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:19.550675 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:19.552433 (+ 1758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:19.552443 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:19.552451 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:19.553527 (+ 1076us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:19.553643 (+ 116us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:19.553692 (+ 49us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:19.553840 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:19.554561 (+ 721us) server_negotiation.cc:299] Negotiation successful
0809 06:52:19.554722 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 06:52:19.555424 14246 sys_catalog.cc:458] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:19.556803 14256 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:19.562273 14256 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:19.571686 14256 catalog_manager.cc:1347] Generated new cluster ID: cc9ec8ad3874418b9d789895d8258439
I20260809 06:52:19.571887 14256 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:19.582700 14256 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:19.584656 14256 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:19.598358 14256 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e25186cf0b7442dba22e46fd88df171e: Generated new TSK 0
I20260809 06:52:19.599411 14256 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:52:19.611034 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 14163
I20260809 06:52:19.612339 14227 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:19.710304 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 14163
2026-08-09T06:52:19Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2981 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:52:19 dist-test-slave-0b58 krb5kdc[14268](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:52:19 dist-test-slave-0b58 krb5kdc[14268](info): set up 2 sockets
Aug 09 06:52:19 dist-test-slave-0b58 krb5kdc[14268](info): commencing operation
krb5kdc: starting...
W20260809 06:52:21.007006 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:52:21 dist-test-slave-0b58 krb5kdc[14268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:52:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:52:21.233717 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:38947
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:45069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:38947
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:21.562610 14284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:21.562961 14284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:21.563136 14284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:21.570524 14284 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:21.570684 14284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:21.570811 14284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:21.570907 14284 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:21.570998 14284 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:21.581148 14284 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:45069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:38947
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:38947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:21.582592 14284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:21.583890 14284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:21.596192 14290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:21.596138 14289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:21.596225 14292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:21.597038 14284 server_base.cc:1034] running on GCE node
I20260809 06:52:21.597844 14284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:21.599203 14284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:21.600383 14284 hybrid_clock.cc:648] HybridClock initialized: now 1786258341600306 us; error 38 us; skew 500 ppm
I20260809 06:52:21.600699 14284 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:21 dist-test-slave-0b58 krb5kdc[14268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258341, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:21.603904 14284 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:52:21.605429 14284 webserver.cc:460] Webserver started at http://127.10.205.126:44271/ using document root <none> and password file <none>
I20260809 06:52:21.606155 14284 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:21.606307 14284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:21.606630 14284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:21.609862 14284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "b3c54037b7cc40608218f4e33482ada3"
format_stamp: "Formatted at 2026-08-09 06:52:21 on dist-test-slave-0b58"
server_key: "d46a341e062eb5ec251159c8a56e6ce9"
server_key_iv: "a0ec75dca5f4a6838225d3dad1555fc9"
server_key_version: "encryptionkey@0"
I20260809 06:52:21.610642 14284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "b3c54037b7cc40608218f4e33482ada3"
format_stamp: "Formatted at 2026-08-09 06:52:21 on dist-test-slave-0b58"
server_key: "d46a341e062eb5ec251159c8a56e6ce9"
server_key_iv: "a0ec75dca5f4a6838225d3dad1555fc9"
server_key_version: "encryptionkey@0"
I20260809 06:52:21.615904 14284 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 06:52:21.619323 14299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:21.620697 14284 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:21.620890 14284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "b3c54037b7cc40608218f4e33482ada3"
format_stamp: "Formatted at 2026-08-09 06:52:21 on dist-test-slave-0b58"
server_key: "d46a341e062eb5ec251159c8a56e6ce9"
server_key_iv: "a0ec75dca5f4a6838225d3dad1555fc9"
server_key_version: "encryptionkey@0"
I20260809 06:52:21.621098 14284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:21.638948 14284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:21.643654 14284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:21.643980 14284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:21.663692 14284 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:38947
I20260809 06:52:21.663699 14354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:38947 every 8 connection(s)
I20260809 06:52:21.665441 14284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:21.666101 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 14284
I20260809 06:52:21.666390 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:21.667259 11061 external_mini_cluster.cc:1428] Setting key fe401e342c049fc60f3b73e28f4446c3
I20260809 06:52:21.670317 14355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:21.680861 14355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3: Bootstrap starting.
Aug 09 06:52:21 dist-test-slave-0b58 krb5kdc[14268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:21.684619 14355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:21.685755 14355 log.cc:824] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:21.689312 14355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3: No bootstrap required, opened a new log
I20260809 06:52:21.689881 14358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:21.669542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47048 (local address 127.10.205.126:38947)
0809 06:52:21.670347 (+ 805us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:21.670359 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:21.670400 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:52:21.672057 (+ 1657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:21.672080 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:21.672539 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:21.672944 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:21.674425 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:21.675767 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:21.677141 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:21.677825 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:21.678051 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:21.682329 (+ 4278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:21.682337 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:21.682351 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:21.682387 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:21.685573 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:21.686432 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:21.686444 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:21.686454 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:21.686715 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:21.687096 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:21.687104 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:21.687110 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:21.687686 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:21.687919 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:21.688436 (+ 517us) server_negotiation.cc:299] Negotiation successful
0809 06:52:21.688799 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":364,"threads_started":1}
I20260809 06:52:21.696892 14355 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c54037b7cc40608218f4e33482ada3" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38947 } }
I20260809 06:52:21.697325 14355 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:21.697444 14355 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3c54037b7cc40608218f4e33482ada3, State: Initialized, Role: FOLLOWER
I20260809 06:52:21.697996 14355 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c54037b7cc40608218f4e33482ada3" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38947 } }
I20260809 06:52:21.698259 14355 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:21.698413 14355 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:21.698592 14355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:21.701159 14355 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c54037b7cc40608218f4e33482ada3" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38947 } }
I20260809 06:52:21.701685 14355 leader_election.cc:302] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3c54037b7cc40608218f4e33482ada3; no voters:
I20260809 06:52:21.702325 14355 leader_election.cc:288] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:21.702476 14361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:21.703361 14361 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [term 1 LEADER]: Becoming Leader. State: Replica: b3c54037b7cc40608218f4e33482ada3, State: Running, Role: LEADER
I20260809 06:52:21.703974 14361 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c54037b7cc40608218f4e33482ada3" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38947 } }
I20260809 06:52:21.704805 14355 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:21.707088 14364 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3c54037b7cc40608218f4e33482ada3. Latest consensus state: current_term: 1 leader_uuid: "b3c54037b7cc40608218f4e33482ada3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c54037b7cc40608218f4e33482ada3" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38947 } } }
I20260809 06:52:21.707494 14364 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:21.709287 14363 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3c54037b7cc40608218f4e33482ada3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c54037b7cc40608218f4e33482ada3" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38947 } } }
I20260809 06:52:21.709695 14363 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:21.709982 14371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:21.714847 14371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:21.723992 14371 catalog_manager.cc:1347] Generated new cluster ID: 4d87b2ea5b334aab8a3f6c6ef2587e01
I20260809 06:52:21.724141 14371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:21.743214 14371 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:21.745173 14371 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:21.753340 14371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3c54037b7cc40608218f4e33482ada3: Generated new TSK 0
I20260809 06:52:21.754455 14371 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:52:21.812037 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:38947
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:45069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:22.145164 14384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:22.145444 14384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:22.145644 14384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:22.153091 14384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:22.153244 14384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:22.153450 14384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:52:22.164358 14384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:45069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:38947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:22.165796 14384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:22.167217 14384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:22.181597 14392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:22.181622 14389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:22.182376 14390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:22.182376 14384 server_base.cc:1034] running on GCE node
I20260809 06:52:22.183080 14384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:22.184049 14384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:22.185290 14384 hybrid_clock.cc:648] HybridClock initialized: now 1786258342185232 us; error 70 us; skew 500 ppm
I20260809 06:52:22.185629 14384 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:22 dist-test-slave-0b58 krb5kdc[14268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258342, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:22.189083 14384 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:52:22.190747 14384 webserver.cc:460] Webserver started at http://127.10.205.65:40135/ using document root <none> and password file <none>
I20260809 06:52:22.191395 14384 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:22.191576 14384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:22.191910 14384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:22.194938 14384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "32f454f38a33411a9d647f09d7e8da11"
format_stamp: "Formatted at 2026-08-09 06:52:22 on dist-test-slave-0b58"
server_key: "9581abff326570bf74a8a8182063297e"
server_key_iv: "11f86bb342af26fc2d7a6c2d47eef2b1"
server_key_version: "encryptionkey@0"
I20260809 06:52:22.195748 14384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "32f454f38a33411a9d647f09d7e8da11"
format_stamp: "Formatted at 2026-08-09 06:52:22 on dist-test-slave-0b58"
server_key: "9581abff326570bf74a8a8182063297e"
server_key_iv: "11f86bb342af26fc2d7a6c2d47eef2b1"
server_key_version: "encryptionkey@0"
I20260809 06:52:22.201081 14384 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 06:52:22.204684 14399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:22.206140 14384 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 06:52:22.206321 14384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "32f454f38a33411a9d647f09d7e8da11"
format_stamp: "Formatted at 2026-08-09 06:52:22 on dist-test-slave-0b58"
server_key: "9581abff326570bf74a8a8182063297e"
server_key_iv: "11f86bb342af26fc2d7a6c2d47eef2b1"
server_key_version: "encryptionkey@0"
I20260809 06:52:22.206517 14384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:22.219996 14384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:22.224900 14384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:22.225225 14384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:22.226560 14384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:22.228140 14384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:22.228247 14384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:22.228401 14384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:22.228474 14384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:22.264662 14384 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:44179
I20260809 06:52:22.264766 14520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:44179 every 8 connection(s)
I20260809 06:52:22.266017 14384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:52:22.275223 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 14384
I20260809 06:52:22.275484 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:52:22.276376 11061 external_mini_cluster.cc:1428] Setting key bfab81d5184f5a955e8282320a490354
Aug 09 06:52:22 dist-test-slave-0b58 krb5kdc[14268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258342, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:22.287374 14523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:22.268624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:49131 (local address 127.10.205.126:38947)
0809 06:52:22.269100 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:22.269106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:22.270103 (+ 997us) server_negotiation.cc:407] Connection header received
0809 06:52:22.271889 (+ 1786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:22.271893 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:22.271960 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:22.272058 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:22.273573 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:22.274279 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:22.275949 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:22.276619 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:22.276759 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:22.280586 (+ 3827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:22.280595 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:22.280603 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:22.280651 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:22.284413 (+ 3762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:22.285126 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:22.285134 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:22.285140 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:22.285295 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:22.285711 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:22.285718 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:22.285724 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:22.286135 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:22.286291 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:22.286958 (+ 667us) server_negotiation.cc:299] Negotiation successful
0809 06:52:22.287128 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":221,"threads_started":1}
I20260809 06:52:22.288997 14524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:22.269229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:38947 (local address 127.10.205.65:49131)
0809 06:52:22.269942 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:22.269981 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:22.271627 (+ 1646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:22.272322 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:22.272333 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:22.272866 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:22.273420 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:22.273437 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:22.274425 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:22.274429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:22.275792 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:22.275804 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:22.276836 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:22.276841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:22.277047 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:22.277788 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:22.277809 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:22.280358 (+ 2549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:22.284563 (+ 4205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:22.284570 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:22.284583 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:22.285004 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:22.285407 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:22.285410 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:22.285412 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:22.285602 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:22.286261 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:22.286267 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:22.286576 (+ 309us) client_negotiation.cc:769] Sending connection context
0809 06:52:22.286804 (+ 228us) client_negotiation.cc:240] Negotiation successful
0809 06:52:22.287459 (+ 655us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":275,"threads_started":1}
I20260809 06:52:22.290727 14521 heartbeater.cc:347] Connected to a master server at 127.10.205.126:38947
I20260809 06:52:22.291051 14521 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:22.291782 14521 heartbeater.cc:511] Master 127.10.205.126:38947 requested a full tablet report, sending...
I20260809 06:52:22.294024 14317 ts_manager.cc:194] Registered new tserver with Master: 32f454f38a33411a9d647f09d7e8da11 (127.10.205.65:44179)
I20260809 06:52:22.295487 14317 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:49131
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:52:22.332216 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:38947
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:45069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:22.667733 14527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:22.668092 14527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:22.668282 14527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:22.677253 14527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:22.677364 14527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:22.677532 14527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:52:22.687429 14527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:45069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:38947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:22.688827 14527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:22.690150 14527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:22.703210 14532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:22.703311 14535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:22.703320 14533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:22.704389 14527 server_base.cc:1034] running on GCE node
I20260809 06:52:22.705062 14527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:22.705997 14527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:22.707190 14527 hybrid_clock.cc:648] HybridClock initialized: now 1786258342707127 us; error 55 us; skew 500 ppm
I20260809 06:52:22.707518 14527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:22 dist-test-slave-0b58 krb5kdc[14268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258342, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:22.711037 14527 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:52:22.712508 14527 webserver.cc:460] Webserver started at http://127.10.205.66:43151/ using document root <none> and password file <none>
I20260809 06:52:22.713140 14527 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:22.713243 14527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:22.713488 14527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:22.716346 14527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "85e0ef00e3ad41118f12a1cc9ed2c1c8"
format_stamp: "Formatted at 2026-08-09 06:52:22 on dist-test-slave-0b58"
server_key: "395399972b7bcf9c2a1c595c4773b87b"
server_key_iv: "78acef3c14f66e9e9b72dd4b079e3da4"
server_key_version: "encryptionkey@0"
I20260809 06:52:22.717095 14527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "85e0ef00e3ad41118f12a1cc9ed2c1c8"
format_stamp: "Formatted at 2026-08-09 06:52:22 on dist-test-slave-0b58"
server_key: "395399972b7bcf9c2a1c595c4773b87b"
server_key_iv: "78acef3c14f66e9e9b72dd4b079e3da4"
server_key_version: "encryptionkey@0"
I20260809 06:52:22.722059 14527 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:52:22.725522 14542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:22.726886 14527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:22.727021 14527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "85e0ef00e3ad41118f12a1cc9ed2c1c8"
format_stamp: "Formatted at 2026-08-09 06:52:22 on dist-test-slave-0b58"
server_key: "395399972b7bcf9c2a1c595c4773b87b"
server_key_iv: "78acef3c14f66e9e9b72dd4b079e3da4"
server_key_version: "encryptionkey@0"
I20260809 06:52:22.727185 14527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:22.753486 14527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:22.757681 14527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:22.758001 14527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:22.759071 14527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:22.760497 14527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:22.760602 14527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:22.760754 14527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:22.760833 14527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:22.794400 14527 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:43001
I20260809 06:52:22.794447 14666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:43001 every 8 connection(s)
I20260809 06:52:22.795701 14527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:52:22.796137 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 14527
I20260809 06:52:22.796376 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:52:22.796859 11061 external_mini_cluster.cc:1428] Setting key 1379b3bd0151e5b6003673766d599251
Aug 09 06:52:22 dist-test-slave-0b58 krb5kdc[14268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258342, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
I20260809 06:52:22.821641 14670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:22.798613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:58319 (local address 127.10.205.126:38947)
0809 06:52:22.804639 (+ 6026us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:22.804644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:22.804660 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:52:22.804706 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:22.804710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:22.804765 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:22.804893 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:22.807087 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:22.807829 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:22.809733 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:22.810548 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:22.810749 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:22.814733 (+ 3984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:22.814743 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:22.814751 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:22.814811 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:22.818534 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:22.819268 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:22.819276 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:22.819279 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:22.819463 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:22.819895 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:22.819903 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:22.819908 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:22.820351 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:22.820505 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:22.821194 (+ 689us) server_negotiation.cc:299] Negotiation successful
0809 06:52:22.821364 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5923,"thread_start_us":5823,"threads_started":1}
I20260809 06:52:22.822651 14671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:22.799187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:38947 (local address 127.10.205.66:58319)
0809 06:52:22.800229 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:22.800330 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:22.803602 (+ 3272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:22.805194 (+ 1592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:22.805208 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:22.806046 (+ 838us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:22.806888 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:22.806919 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:22.807993 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:22.807999 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:22.809545 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:22.809562 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:22.810973 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:22.810985 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:22.811391 (+ 406us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:22.812234 (+ 843us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:22.812322 (+ 88us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:22.814482 (+ 2160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:22.818674 (+ 4192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:22.818680 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:22.818692 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:22.819113 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:22.819579 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:22.819582 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:22.819584 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:22.819760 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:22.820475 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:22.820481 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:22.820829 (+ 348us) client_negotiation.cc:769] Sending connection context
0809 06:52:22.821079 (+ 250us) client_negotiation.cc:240] Negotiation successful
0809 06:52:22.821480 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":387,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
I20260809 06:52:22.824295 14667 heartbeater.cc:347] Connected to a master server at 127.10.205.126:38947
I20260809 06:52:22.824626 14667 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:22.825469 14667 heartbeater.cc:511] Master 127.10.205.126:38947 requested a full tablet report, sending...
I20260809 06:52:22.827129 14317 ts_manager.cc:194] Registered new tserver with Master: 85e0ef00e3ad41118f12a1cc9ed2c1c8 (127.10.205.66:43001)
I20260809 06:52:22.828439 14317 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:58319
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:52:22.849946 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:38947
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:45069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:23.177747 14674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:23.178071 14674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:23.178249 14674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:23.185947 14674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:23.186111 14674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:23.186307 14674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:52:23.196019 14674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:45069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:38947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:23.197392 14674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:23.198711 14674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:23.212709 14680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:23.213164 14682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:23.213199 14679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:23.213636 14674 server_base.cc:1034] running on GCE node
I20260809 06:52:23.214232 14674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:23.215204 14674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:23.216416 14674 hybrid_clock.cc:648] HybridClock initialized: now 1786258343216367 us; error 56 us; skew 500 ppm
I20260809 06:52:23.216738 14674 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:23 dist-test-slave-0b58 krb5kdc[14268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258343, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:23.219883 14674 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:52:23.221382 14674 webserver.cc:460] Webserver started at http://127.10.205.67:34237/ using document root <none> and password file <none>
I20260809 06:52:23.222077 14674 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:23.222224 14674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:23.222554 14674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:23.225782 14674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "058feb0c64c246dcad4798ccc22b86b0"
format_stamp: "Formatted at 2026-08-09 06:52:23 on dist-test-slave-0b58"
server_key: "0d242f8b1b464c65c1c6adaed8fdd86b"
server_key_iv: "21fa57f5cb3cf6252c2a59cad953e649"
server_key_version: "encryptionkey@0"
I20260809 06:52:23.226605 14674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "058feb0c64c246dcad4798ccc22b86b0"
format_stamp: "Formatted at 2026-08-09 06:52:23 on dist-test-slave-0b58"
server_key: "0d242f8b1b464c65c1c6adaed8fdd86b"
server_key_iv: "21fa57f5cb3cf6252c2a59cad953e649"
server_key_version: "encryptionkey@0"
I20260809 06:52:23.231798 14674 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 06:52:23.235422 14690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:23.236816 14674 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 06:52:23.236997 14674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "058feb0c64c246dcad4798ccc22b86b0"
format_stamp: "Formatted at 2026-08-09 06:52:23 on dist-test-slave-0b58"
server_key: "0d242f8b1b464c65c1c6adaed8fdd86b"
server_key_iv: "21fa57f5cb3cf6252c2a59cad953e649"
server_key_version: "encryptionkey@0"
I20260809 06:52:23.237236 14674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:23.258496 14674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:23.262578 14674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:23.262892 14674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:23.263906 14674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:23.265658 14674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:23.265764 14674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:23.265887 14674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:23.265942 14674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:23.298571 14521 heartbeater.cc:503] Master 127.10.205.126:38947 was elected leader, sending a full tablet report...
I20260809 06:52:23.300655 14674 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:43905
I20260809 06:52:23.300729 14813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:43905 every 8 connection(s)
I20260809 06:52:23.301997 14674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:52:23.311781 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 14674
I20260809 06:52:23.312040 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:52:23.312574 11061 external_mini_cluster.cc:1428] Setting key 270e05a1316c664febec8784f2d7f241
Aug 09 06:52:23 dist-test-slave-0b58 krb5kdc[14268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258343, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:23.322026 14670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:23.304539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:42125 (local address 127.10.205.126:38947)
0809 06:52:23.304713 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:23.304718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:23.306044 (+ 1326us) server_negotiation.cc:407] Connection header received
0809 06:52:23.307803 (+ 1759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:23.307807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:23.307887 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:23.307975 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:23.309600 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:23.310355 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:23.312168 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:23.312656 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:23.312813 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:23.316960 (+ 4147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:23.316964 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:23.316967 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:23.316999 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:23.319435 (+ 2436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:23.320098 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:23.320102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:23.320104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:23.320219 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:23.320652 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:23.320655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:23.320657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:23.320907 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:23.321032 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:23.321632 (+ 600us) server_negotiation.cc:299] Negotiation successful
0809 06:52:23.321794 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:52:23.322968 14816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:23.305075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:38947 (local address 127.10.205.67:42125)
0809 06:52:23.305889 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:23.305928 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:23.307567 (+ 1639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:23.308180 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:23.308188 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:23.308823 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:23.309361 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:23.309413 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:23.310527 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:23.310540 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:23.312025 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:23.312038 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:23.312917 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:23.312926 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:23.313228 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:23.314076 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:23.314109 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:23.316753 (+ 2644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:23.319552 (+ 2799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:23.319558 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:23.319569 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:23.320000 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:23.320381 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:23.320384 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:23.320386 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:23.320558 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:23.321011 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:23.321016 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:23.321314 (+ 298us) client_negotiation.cc:769] Sending connection context
0809 06:52:23.321547 (+ 233us) client_negotiation.cc:240] Negotiation successful
0809 06:52:23.321927 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":275,"threads_started":1}
I20260809 06:52:23.324342 14814 heartbeater.cc:347] Connected to a master server at 127.10.205.126:38947
I20260809 06:52:23.324664 14814 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:23.325428 14814 heartbeater.cc:511] Master 127.10.205.126:38947 requested a full tablet report, sending...
I20260809 06:52:23.327020 14317 ts_manager.cc:194] Registered new tserver with Master: 058feb0c64c246dcad4798ccc22b86b0 (127.10.205.67:43905)
I20260809 06:52:23.327958 14317 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:42125
I20260809 06:52:23.328521 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 06:52:23 dist-test-slave-0b58 krb5kdc[14268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258343, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 06:52:23 dist-test-slave-0b58 krb5kdc[14268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258343, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:23.383008 14670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:23.369413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47056 (local address 127.10.205.126:38947)
0809 06:52:23.369602 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:23.369606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:23.370087 (+ 481us) server_negotiation.cc:407] Connection header received
0809 06:52:23.370245 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:23.370249 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:23.370344 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:23.370437 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:23.371844 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:23.372664 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:23.373876 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:23.374295 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:23.374385 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:23.378364 (+ 3979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:23.378369 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:23.378372 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:23.378406 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:23.380895 (+ 2489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:23.381460 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:23.381463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:23.381466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:23.381593 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:23.381892 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:23.381895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:23.381897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:23.382199 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:23.382402 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:23.382628 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 06:52:23.382780 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 06:52:23.383605 14317 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:47056
I20260809 06:52:23.385581 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 14384
Aug 09 06:52:23 dist-test-slave-0b58 krb5kdc[14268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258343, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:52:23.400707 14825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:23.386619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56752 (local address 127.10.205.65:44179)
0809 06:52:23.387231 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:23.387237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:23.387261 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:52:23.387331 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:23.387337 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:23.387528 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:23.387662 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:23.388849 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:23.389860 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:23.390995 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:23.391526 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:23.391617 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:23.395393 (+ 3776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:23.395405 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:23.395419 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:23.395455 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:23.398086 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:23.398684 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:23.398691 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:23.398693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:23.398809 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:23.399122 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:23.399125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:23.399127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:23.399459 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:23.399763 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:23.400058 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 06:52:23.400382 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":307,"threads_started":1}
W20260809 06:52:23.401896 14515 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:56752
W20260809 06:52:23.402969 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 14384: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:52:23.403153 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 14384
I20260809 06:52:23.422183 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 14527
Aug 09 06:52:23 dist-test-slave-0b58 krb5kdc[14268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258343, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:52:23.438431 14826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:23.423146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38132 (local address 127.10.205.66:43001)
0809 06:52:23.423695 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:23.423701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:23.423725 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:52:23.423786 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:23.423793 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:23.424000 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:23.424171 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:23.425557 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:23.426600 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:23.427894 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:23.428551 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:23.428703 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:23.433100 (+ 4397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:23.433111 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:23.433125 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:23.433161 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:23.435770 (+ 2609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:23.436591 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:23.436599 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:23.436601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:23.436732 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:23.437087 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:23.437090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:23.437091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:23.437425 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:23.437676 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:23.437921 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 06:52:23.438118 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":271,"threads_started":1}
W20260809 06:52:23.439699 14661 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38132
W20260809 06:52:23.440816 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 14527: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:52:23.440995 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 14527
I20260809 06:52:23.459914 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 14674
Aug 09 06:52:23 dist-test-slave-0b58 krb5kdc[14268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258343, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:52:23.477087 14827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:23.460996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35318 (local address 127.10.205.67:43905)
0809 06:52:23.461714 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:23.461721 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:23.461751 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:52:23.461811 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:23.461817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:23.462028 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:23.462204 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:23.463648 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:23.464785 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:23.466070 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:23.466658 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:23.466799 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:23.471387 (+ 4588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:23.471399 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:23.471413 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:23.471453 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:23.474192 (+ 2739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:23.474893 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:23.474907 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:23.474910 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:23.475037 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:23.475413 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:23.475418 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:23.475422 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:23.475781 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:23.476097 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:23.476453 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 06:52:23.476733 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":385,"threads_started":1}
W20260809 06:52:23.478437 14809 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:35318
W20260809 06:52:23.479557 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 14674: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:52:23.479696 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 14674
I20260809 06:52:23.497380 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 14284
I20260809 06:52:23.498631 14350 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:23.603400 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 14284
2026-08-09T06:52:23Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3896 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:52:23 dist-test-slave-0b58 krb5kdc[14831](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:52:23 dist-test-slave-0b58 krb5kdc[14831](info): set up 2 sockets
Aug 09 06:52:23 dist-test-slave-0b58 krb5kdc[14831](info): commencing operation
krb5kdc: starting...
W20260809 06:52:24.731248 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:52:24 dist-test-slave-0b58 krb5kdc[14831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:52:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:52:24.955977 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:43971
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:35703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:43971
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:25.279354 14844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:25.279675 14844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:25.279839 14844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:25.287079 14844 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:25.287232 14844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:25.287338 14844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:25.287436 14844 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:25.287516 14844 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:25.297520 14844 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:35703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:43971
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:43971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:25.298828 14844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:25.300132 14844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:25.311847 14849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:25.311807 14852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:25.311759 14850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:25.312961 14844 server_base.cc:1034] running on GCE node
I20260809 06:52:25.313705 14844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:25.315043 14844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:25.316314 14844 hybrid_clock.cc:648] HybridClock initialized: now 1786258345316211 us; error 42 us; skew 500 ppm
I20260809 06:52:25.316665 14844 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:25 dist-test-slave-0b58 krb5kdc[14831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:25.325239 14844 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:52:25.326716 14844 webserver.cc:460] Webserver started at http://127.10.205.126:46267/ using document root <none> and password file <none>
I20260809 06:52:25.327414 14844 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:25.327558 14844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:25.327877 14844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:25.330866 14844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "ed5477f237334f369f711824471881ac"
format_stamp: "Formatted at 2026-08-09 06:52:25 on dist-test-slave-0b58"
server_key: "87a2e035deed459e39d5ae05f5251a2b"
server_key_iv: "1d3d6ca3c36cae91da549cb096f5ab1a"
server_key_version: "encryptionkey@0"
I20260809 06:52:25.331660 14844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "ed5477f237334f369f711824471881ac"
format_stamp: "Formatted at 2026-08-09 06:52:25 on dist-test-slave-0b58"
server_key: "87a2e035deed459e39d5ae05f5251a2b"
server_key_iv: "1d3d6ca3c36cae91da549cb096f5ab1a"
server_key_version: "encryptionkey@0"
I20260809 06:52:25.336819 14844 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 06:52:25.340103 14860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:25.341395 14844 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:25.341580 14844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "ed5477f237334f369f711824471881ac"
format_stamp: "Formatted at 2026-08-09 06:52:25 on dist-test-slave-0b58"
server_key: "87a2e035deed459e39d5ae05f5251a2b"
server_key_iv: "1d3d6ca3c36cae91da549cb096f5ab1a"
server_key_version: "encryptionkey@0"
I20260809 06:52:25.341780 14844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:25.356063 14844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:25.359894 14844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:25.360183 14844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:25.378031 14844 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:43971
I20260809 06:52:25.378049 14914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:43971 every 8 connection(s)
I20260809 06:52:25.379370 14844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:25.382807 14915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:25.386680 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 14844
I20260809 06:52:25.386906 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:25.387560 11061 external_mini_cluster.cc:1428] Setting key ad88ca1ff4c76fb413ff842fdf0f3001
I20260809 06:52:25.393316 14915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac: Bootstrap starting.
I20260809 06:52:25.396932 14915 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:25.398144 14915 log.cc:824] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:25.400907 14915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac: No bootstrap required, opened a new log
Aug 09 06:52:25 dist-test-slave-0b58 krb5kdc[14831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:25.409999 14915 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5477f237334f369f711824471881ac" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 43971 } }
I20260809 06:52:25.410377 14915 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:25.410498 14915 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed5477f237334f369f711824471881ac, State: Initialized, Role: FOLLOWER
I20260809 06:52:25.410610 14919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:25.389475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38570 (local address 127.10.205.126:43971)
0809 06:52:25.390285 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:25.390303 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:25.390344 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:52:25.392101 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:25.392122 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:25.392522 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:25.392808 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:25.394760 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:25.396098 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:25.397902 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:25.398706 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:25.398916 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:25.403180 (+ 4264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:25.403190 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:25.403204 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:25.403237 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:25.406486 (+ 3249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:25.407278 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:25.407292 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:25.407297 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:25.407456 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:25.407838 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:25.407843 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:25.407846 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:25.408458 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:25.408688 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:25.409154 (+ 466us) server_negotiation.cc:299] Negotiation successful
0809 06:52:25.409504 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":350,"threads_started":1}
I20260809 06:52:25.411120 14915 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5477f237334f369f711824471881ac" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 43971 } }
I20260809 06:52:25.411386 14915 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:25.411542 14915 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:25.411733 14915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:25.414770 14915 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5477f237334f369f711824471881ac" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 43971 } }
I20260809 06:52:25.415402 14915 leader_election.cc:302] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed5477f237334f369f711824471881ac; no voters:
I20260809 06:52:25.416200 14915 leader_election.cc:288] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:25.416347 14921 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:25.417189 14921 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [term 1 LEADER]: Becoming Leader. State: Replica: ed5477f237334f369f711824471881ac, State: Running, Role: LEADER
I20260809 06:52:25.417795 14921 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5477f237334f369f711824471881ac" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 43971 } }
I20260809 06:52:25.418670 14915 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:25.421983 14923 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed5477f237334f369f711824471881ac. Latest consensus state: current_term: 1 leader_uuid: "ed5477f237334f369f711824471881ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5477f237334f369f711824471881ac" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 43971 } } }
I20260809 06:52:25.422237 14922 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed5477f237334f369f711824471881ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed5477f237334f369f711824471881ac" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 43971 } } }
I20260809 06:52:25.422533 14923 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:25.422634 14922 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:25.424450 14929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:25.430018 14929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:25.439038 14929 catalog_manager.cc:1347] Generated new cluster ID: 641dc8b7663b42fba5c9b46549d221ce
I20260809 06:52:25.439157 14929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:25.451318 14929 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:25.452706 14929 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:25.462044 14929 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed5477f237334f369f711824471881ac: Generated new TSK 0
I20260809 06:52:25.462891 14929 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:52:25.518095 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:43971
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:35703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:25.857425 14945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:25.857710 14945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:25.857878 14945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:25.865306 14945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:25.865423 14945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:25.865626 14945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:52:25.875554 14945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:35703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:43971
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:25.876924 14945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:25.878304 14945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:25.891467 14950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:25.891431 14954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:25.891497 14951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:25.892650 14945 server_base.cc:1034] running on GCE node
I20260809 06:52:25.893297 14945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:25.894239 14945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:25.895462 14945 hybrid_clock.cc:648] HybridClock initialized: now 1786258345895407 us; error 51 us; skew 500 ppm
I20260809 06:52:25.895781 14945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:25 dist-test-slave-0b58 krb5kdc[14831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:25.899034 14945 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:52:25.900552 14945 webserver.cc:460] Webserver started at http://127.10.205.65:41423/ using document root <none> and password file <none>
I20260809 06:52:25.901247 14945 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:25.901387 14945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:25.901717 14945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:25.904726 14945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "42413811df754fb6a89504c7b59d41a2"
format_stamp: "Formatted at 2026-08-09 06:52:25 on dist-test-slave-0b58"
server_key: "0c3d6a2cf801329bcde40b62f4114bf9"
server_key_iv: "1192be465ae8e7e397cd506cf5317935"
server_key_version: "encryptionkey@0"
I20260809 06:52:25.905524 14945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "42413811df754fb6a89504c7b59d41a2"
format_stamp: "Formatted at 2026-08-09 06:52:25 on dist-test-slave-0b58"
server_key: "0c3d6a2cf801329bcde40b62f4114bf9"
server_key_iv: "1192be465ae8e7e397cd506cf5317935"
server_key_version: "encryptionkey@0"
I20260809 06:52:25.910714 14945 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 06:52:25.914204 14961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:25.915518 14945 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:52:25.915681 14945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "42413811df754fb6a89504c7b59d41a2"
format_stamp: "Formatted at 2026-08-09 06:52:25 on dist-test-slave-0b58"
server_key: "0c3d6a2cf801329bcde40b62f4114bf9"
server_key_iv: "1192be465ae8e7e397cd506cf5317935"
server_key_version: "encryptionkey@0"
I20260809 06:52:25.915894 14945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:25.928675 14945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:25.932778 14945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:25.933075 14945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:25.934154 14945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:25.935959 14945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:25.936038 14945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:25.936173 14945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:25.936280 14945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:25.969795 14945 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:42557
I20260809 06:52:25.969846 15083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:42557 every 8 connection(s)
I20260809 06:52:25.971227 14945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:52:25.981398 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 14945
I20260809 06:52:25.981613 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:52:25.982390 11061 external_mini_cluster.cc:1428] Setting key 26174006d22b18b1e7ce2148de3b61d3
Aug 09 06:52:25 dist-test-slave-0b58 krb5kdc[14831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258345, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:25.992242 15087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:25.973748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:49063 (local address 127.10.205.126:43971)
0809 06:52:25.974239 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:25.974246 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:25.975174 (+ 928us) server_negotiation.cc:407] Connection header received
0809 06:52:25.977064 (+ 1890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:25.977069 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:25.977140 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:25.977227 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:25.978649 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:25.979372 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:25.980982 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:25.981644 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:25.981781 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:25.985366 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:25.985374 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:25.985381 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:25.985425 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:25.989030 (+ 3605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:25.989725 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:25.989733 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:25.989739 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:25.989899 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:25.990294 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:25.990302 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:25.990308 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:25.990683 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:25.990841 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:25.991502 (+ 661us) server_negotiation.cc:299] Negotiation successful
0809 06:52:25.991775 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":223,"threads_started":1}
I20260809 06:52:25.992887 15088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:25.974323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:43971 (local address 127.10.205.65:49063)
0809 06:52:25.975011 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:25.975059 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:25.976800 (+ 1741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:25.977429 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:25.977437 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:25.977954 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:25.978505 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:25.978522 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:25.979505 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:25.979508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:25.980848 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:25.980859 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:25.981864 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:25.981869 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:25.982056 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:25.982776 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:25.982798 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:25.985148 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:25.989159 (+ 4011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:25.989165 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:25.989178 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:25.989595 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:25.990003 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:25.990006 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:25.990008 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:25.990181 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:25.990810 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:25.990815 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:25.991119 (+ 304us) client_negotiation.cc:769] Sending connection context
0809 06:52:25.991345 (+ 226us) client_negotiation.cc:240] Negotiation successful
0809 06:52:25.991729 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":257,"threads_started":1}
I20260809 06:52:25.994465 15085 heartbeater.cc:347] Connected to a master server at 127.10.205.126:43971
I20260809 06:52:25.994772 15085 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:25.995487 15085 heartbeater.cc:511] Master 127.10.205.126:43971 requested a full tablet report, sending...
I20260809 06:52:25.997538 14877 ts_manager.cc:194] Registered new tserver with Master: 42413811df754fb6a89504c7b59d41a2 (127.10.205.65:42557)
I20260809 06:52:25.998970 14877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:49063
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:52:26.035065 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:43971
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:35703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:26.370662 15091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:26.370949 15091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:26.371040 15091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:26.378832 15091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:26.378968 15091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:26.379146 15091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:52:26.394671 15091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:35703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:43971
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:26.396385 15091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:26.398036 15091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:26.411970 15096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:26.412153 15097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:26.412134 15101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:26.413378 15091 server_base.cc:1034] running on GCE node
I20260809 06:52:26.414062 15091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:26.415091 15091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:26.416379 15091 hybrid_clock.cc:648] HybridClock initialized: now 1786258346416304 us; error 47 us; skew 500 ppm
I20260809 06:52:26.416712 15091 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:26 dist-test-slave-0b58 krb5kdc[14831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258346, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:26.420136 15091 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:52:26.421767 15091 webserver.cc:460] Webserver started at http://127.10.205.66:43805/ using document root <none> and password file <none>
I20260809 06:52:26.422497 15091 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:26.422639 15091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:26.422976 15091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:26.426188 15091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "6b5a51523748499aa14b58427f759cd1"
format_stamp: "Formatted at 2026-08-09 06:52:26 on dist-test-slave-0b58"
server_key: "d35bd048f7165d7e83dca7e080276add"
server_key_iv: "fc8ecd86b18fede9312257630ae2770d"
server_key_version: "encryptionkey@0"
I20260809 06:52:26.427002 15091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "6b5a51523748499aa14b58427f759cd1"
format_stamp: "Formatted at 2026-08-09 06:52:26 on dist-test-slave-0b58"
server_key: "d35bd048f7165d7e83dca7e080276add"
server_key_iv: "fc8ecd86b18fede9312257630ae2770d"
server_key_version: "encryptionkey@0"
I20260809 06:52:26.432500 15091 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 06:52:26.435923 15108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:26.437294 15091 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:26.437477 15091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "6b5a51523748499aa14b58427f759cd1"
format_stamp: "Formatted at 2026-08-09 06:52:26 on dist-test-slave-0b58"
server_key: "d35bd048f7165d7e83dca7e080276add"
server_key_iv: "fc8ecd86b18fede9312257630ae2770d"
server_key_version: "encryptionkey@0"
I20260809 06:52:26.437693 15091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:26.458528 15091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:26.462634 15091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:26.462949 15091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:26.463934 15091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:26.465366 15091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:26.465471 15091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:26.465623 15091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:26.465693 15091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:26.500236 15091 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:41227
I20260809 06:52:26.500350 15229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:41227 every 8 connection(s)
I20260809 06:52:26.501564 15091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:52:26.509057 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 15091
I20260809 06:52:26.509233 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:52:26.509711 11061 external_mini_cluster.cc:1428] Setting key f971fa62dd3c7754a9f68dcaaa0d40f7
Aug 09 06:52:26 dist-test-slave-0b58 krb5kdc[14831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258346, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:26.522286 15232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:26.504194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:60439 (local address 127.10.205.126:43971)
0809 06:52:26.504697 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:26.504702 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:26.505678 (+ 976us) server_negotiation.cc:407] Connection header received
0809 06:52:26.507582 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:26.507587 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:26.507674 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:26.507803 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:26.509445 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:26.510274 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:26.512157 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:26.512659 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:26.512791 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:26.516186 (+ 3395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:26.516191 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:26.516194 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:26.516226 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:26.518922 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:26.519674 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:26.519681 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:26.519685 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:26.519924 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:26.520469 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:26.520476 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:26.520479 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:26.520755 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:26.520948 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:26.521645 (+ 697us) server_negotiation.cc:299] Negotiation successful
0809 06:52:26.521874 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":242,"threads_started":1}
I20260809 06:52:26.523316 15233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:26.504822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:43971 (local address 127.10.205.66:60439)
0809 06:52:26.505520 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:26.505557 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:26.507275 (+ 1718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:26.508039 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:26.508048 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:26.508653 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:26.509246 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:26.509279 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:26.510418 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:26.510424 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:26.511980 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:26.511993 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:26.512885 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:26.512895 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:26.513116 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:26.513792 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:26.513821 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:26.515958 (+ 2137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:26.519060 (+ 3102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:26.519069 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:26.519085 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:26.519539 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:26.520092 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:26.520097 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:26.520101 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:26.520357 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:26.520917 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:26.520925 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:26.521285 (+ 360us) client_negotiation.cc:769] Sending connection context
0809 06:52:26.521550 (+ 265us) client_negotiation.cc:240] Negotiation successful
0809 06:52:26.522111 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":264,"threads_started":1}
I20260809 06:52:26.524904 15230 heartbeater.cc:347] Connected to a master server at 127.10.205.126:43971
I20260809 06:52:26.525214 15230 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:26.526014 15230 heartbeater.cc:511] Master 127.10.205.126:43971 requested a full tablet report, sending...
I20260809 06:52:26.527593 14877 ts_manager.cc:194] Registered new tserver with Master: 6b5a51523748499aa14b58427f759cd1 (127.10.205.66:41227)
I20260809 06:52:26.528901 14877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:60439
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:52:26.561739 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:43971
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:35703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:26.889933 15239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:26.890208 15239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:26.890337 15239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:26.897596 15239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:26.897702 15239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:26.897877 15239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:52:26.907516 15239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:35703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:43971
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:26.908906 15239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:26.910332 15239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:26.923820 15245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:26.923741 15249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:26.923782 15247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:26.925285 15239 server_base.cc:1034] running on GCE node
I20260809 06:52:26.925910 15239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:26.926792 15239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:26.928016 15239 hybrid_clock.cc:648] HybridClock initialized: now 1786258346927962 us; error 45 us; skew 500 ppm
I20260809 06:52:26.928375 15239 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:26 dist-test-slave-0b58 krb5kdc[14831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258346, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:26.931460 15239 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:52:26.932996 15239 webserver.cc:460] Webserver started at http://127.10.205.67:37413/ using document root <none> and password file <none>
I20260809 06:52:26.933681 15239 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:26.933825 15239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:26.934134 15239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:26.937068 15239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "bc35d8e219d3448599050b7f4b8b9795"
format_stamp: "Formatted at 2026-08-09 06:52:26 on dist-test-slave-0b58"
server_key: "a5c71980e34d03667c165db90498a17f"
server_key_iv: "1c2fcd4933365f6b04c0003d4668fced"
server_key_version: "encryptionkey@0"
I20260809 06:52:26.937857 15239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "bc35d8e219d3448599050b7f4b8b9795"
format_stamp: "Formatted at 2026-08-09 06:52:26 on dist-test-slave-0b58"
server_key: "a5c71980e34d03667c165db90498a17f"
server_key_iv: "1c2fcd4933365f6b04c0003d4668fced"
server_key_version: "encryptionkey@0"
I20260809 06:52:26.943069 15239 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260809 06:52:26.946537 15257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:26.947786 15239 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 06:52:26.947954 15239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "bc35d8e219d3448599050b7f4b8b9795"
format_stamp: "Formatted at 2026-08-09 06:52:26 on dist-test-slave-0b58"
server_key: "a5c71980e34d03667c165db90498a17f"
server_key_iv: "1c2fcd4933365f6b04c0003d4668fced"
server_key_version: "encryptionkey@0"
I20260809 06:52:26.948176 15239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:26.969483 15239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:26.974045 15239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:26.974356 15239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:26.975311 15239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:26.976670 15239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:26.976775 15239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:26.976929 15239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:26.976999 15239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:27.001960 15085 heartbeater.cc:503] Master 127.10.205.126:43971 was elected leader, sending a full tablet report...
I20260809 06:52:27.012212 15239 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:41919
I20260809 06:52:27.012316 15380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:41919 every 8 connection(s)
I20260809 06:52:27.013571 15239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:52:27.023928 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 15239
I20260809 06:52:27.024143 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:52:27.024802 11061 external_mini_cluster.cc:1428] Setting key 8fed33aac967294c563c77932eb28b55
Aug 09 06:52:27 dist-test-slave-0b58 krb5kdc[14831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258346, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:27.033562 15232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:27.015935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:40007 (local address 127.10.205.126:43971)
0809 06:52:27.016173 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:27.016180 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:27.017408 (+ 1228us) server_negotiation.cc:407] Connection header received
0809 06:52:27.019413 (+ 2005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:27.019419 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:27.019525 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:27.019634 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:27.021286 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.022036 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.023604 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.024019 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.024175 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:27.028414 (+ 4239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:27.028419 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:27.028422 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:27.028457 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:27.030870 (+ 2413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:27.031540 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:27.031543 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:27.031545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:27.031666 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:27.032035 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:27.032038 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:27.032040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:27.032353 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:27.032486 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:27.033144 (+ 658us) server_negotiation.cc:299] Negotiation successful
0809 06:52:27.033321 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 06:52:27.034578 15385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:27.016539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:43971 (local address 127.10.205.67:40007)
0809 06:52:27.017245 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:27.017282 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:27.019039 (+ 1757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:27.019876 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:27.019884 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:27.020547 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:27.021110 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:27.021131 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.022187 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.022193 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:27.023450 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:27.023462 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.024335 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.024345 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:27.024628 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:27.025422 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:27.025452 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:27.028202 (+ 2750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:27.030990 (+ 2788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:27.030996 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:27.031008 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:27.031434 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:27.031752 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:27.031754 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:27.031757 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:27.031940 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:27.032455 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:27.032461 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:27.032828 (+ 367us) client_negotiation.cc:769] Sending connection context
0809 06:52:27.033057 (+ 229us) client_negotiation.cc:240] Negotiation successful
0809 06:52:27.033452 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":274,"threads_started":1}
I20260809 06:52:27.035856 15382 heartbeater.cc:347] Connected to a master server at 127.10.205.126:43971
I20260809 06:52:27.036167 15382 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:27.036904 15382 heartbeater.cc:511] Master 127.10.205.126:43971 requested a full tablet report, sending...
I20260809 06:52:27.038312 14877 ts_manager.cc:194] Registered new tserver with Master: bc35d8e219d3448599050b7f4b8b9795 (127.10.205.67:41919)
I20260809 06:52:27.039309 14877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:40007
I20260809 06:52:27.040457 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 06:52:27 dist-test-slave-0b58 krb5kdc[14831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 06:52:27 dist-test-slave-0b58 krb5kdc[14831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:52:27.094810 15392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:27.080330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44324 (local address 127.10.205.65:42557)
0809 06:52:27.080941 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:27.080948 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:27.080975 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:52:27.081089 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:27.081095 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:27.081314 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:27.081449 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:27.082894 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.083890 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.085071 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.085622 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.085714 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:27.089672 (+ 3958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:27.089683 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:27.089697 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:27.089729 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:27.092487 (+ 2758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:27.093084 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:27.093091 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:27.093093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:27.093216 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:27.093536 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:27.093539 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:27.093541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:27.093871 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:27.094085 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:27.094327 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 06:52:27.094512 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":295,"threads_started":1}
Aug 09 06:52:27 dist-test-slave-0b58 krb5kdc[14831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:27.111765 15232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:27.099000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38584 (local address 127.10.205.126:43971)
0809 06:52:27.099232 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:27.099238 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:27.099413 (+ 175us) server_negotiation.cc:407] Connection header received
0809 06:52:27.099536 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:27.099540 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:27.099617 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:27.099694 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:27.100887 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.101599 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.102799 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.103212 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.103355 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:27.106965 (+ 3610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:27.106970 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:27.106973 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:27.107004 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:27.109309 (+ 2305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:27.109867 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:27.109873 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:27.109876 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:27.110017 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:27.110380 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:27.110385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:27.110389 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:27.110690 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:27.110962 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:27.111236 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 06:52:27.111451 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
W20260809 06:52:27.112336 14877 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38584
I20260809 06:52:27.113317 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 14945
I20260809 06:52:27.125962 15392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:27.114249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44326 (local address 127.10.205.65:42557)
0809 06:52:27.114448 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:27.114454 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:27.114612 (+ 158us) server_negotiation.cc:407] Connection header received
0809 06:52:27.114787 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:27.114792 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:27.114859 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:27.114952 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:27.116140 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.116901 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.118066 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.118535 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.118660 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:27.121036 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:27.121042 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:27.121047 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:27.121083 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:27.123406 (+ 2323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:27.124023 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:27.124030 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:27.124034 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:27.124167 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:27.124563 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:27.124569 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:27.124572 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:27.124819 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:27.125059 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:27.125383 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 06:52:27.125622 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:52:27.126549 15079 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:27.208142 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 14945
I20260809 06:52:27.228055 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 15091
Aug 09 06:52:27 dist-test-slave-0b58 krb5kdc[14831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:52:27.244071 15397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:27.229002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49128 (local address 127.10.205.66:41227)
0809 06:52:27.229556 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:27.229562 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:27.229586 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:52:27.229646 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:27.229654 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:27.229859 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:27.229990 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:27.231222 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.232192 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.233579 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.234125 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.234227 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:27.238453 (+ 4226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:27.238464 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:27.238478 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:27.238520 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:27.241432 (+ 2912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:27.242113 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:27.242121 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:27.242123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:27.242251 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:27.242616 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:27.242621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:27.242623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:27.242952 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:27.243181 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:27.243466 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 06:52:27.243679 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":279,"threads_started":1}
I20260809 06:52:27.245463 15225 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:27.329342 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 15091
I20260809 06:52:27.347901 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 15239
Aug 09 06:52:27 dist-test-slave-0b58 krb5kdc[14831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:52:27.364024 15399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:27.348992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56044 (local address 127.10.205.67:41919)
0809 06:52:27.349603 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:27.349628 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:27.349658 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:52:27.349721 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:27.349727 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:27.349947 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:27.350138 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:27.351505 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.352619 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.353896 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:27.354455 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:27.354551 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:27.358784 (+ 4233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:27.358796 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:27.358811 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:27.358842 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:27.361603 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:27.362186 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:27.362192 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:27.362194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:27.362324 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:27.362623 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:27.362626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:27.362628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:27.362956 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:27.363192 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:27.363450 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 06:52:27.363632 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":289,"threads_started":1}
I20260809 06:52:27.365317 15376 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:27.446772 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 15239
I20260809 06:52:27.465167 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 14844
I20260809 06:52:27.466485 14910 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:27.571692 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 14844
2026-08-09T06:52:27Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3967 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:52:27 dist-test-slave-0b58 krb5kdc[15404](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:52:27 dist-test-slave-0b58 krb5kdc[15404](info): set up 2 sockets
Aug 09 06:52:27 dist-test-slave-0b58 krb5kdc[15404](info): commencing operation
krb5kdc: starting...
W20260809 06:52:28.699565 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.004s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:52:28 dist-test-slave-0b58 krb5kdc[15404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:52:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:52:28.935549 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:40373
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:40373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:29.276835 15419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:29.277150 15419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:29.277343 15419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:29.284675 15419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:29.284796 15419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:29.284873 15419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:29.284973 15419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:29.285053 15419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:29.295387 15419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:40373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:40373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:29.296860 15419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:29.298245 15419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:29.310195 15426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:29.310281 15428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:29.310245 15425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:29.311026 15419 server_base.cc:1034] running on GCE node
I20260809 06:52:29.311861 15419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:29.313351 15419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:29.314581 15419 hybrid_clock.cc:648] HybridClock initialized: now 1786258349314491 us; error 77 us; skew 500 ppm
I20260809 06:52:29.314931 15419 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:29 dist-test-slave-0b58 krb5kdc[15404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258349, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:29.318054 15419 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:52:29.319196 15419 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:29.319331 15419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:29.319659 15419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:29.322700 15419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "c2d8a92b9051405f9f527631854bdf83"
format_stamp: "Formatted at 2026-08-09 06:52:29 on dist-test-slave-0b58"
server_key: "26dba61461cef63df95abdd08abf7c36"
server_key_iv: "93cf4fcd8f2be5ab2d935b3adfc4f7af"
server_key_version: "encryptionkey@0"
I20260809 06:52:29.323522 15419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "c2d8a92b9051405f9f527631854bdf83"
format_stamp: "Formatted at 2026-08-09 06:52:29 on dist-test-slave-0b58"
server_key: "26dba61461cef63df95abdd08abf7c36"
server_key_iv: "93cf4fcd8f2be5ab2d935b3adfc4f7af"
server_key_version: "encryptionkey@0"
I20260809 06:52:29.328717 15419 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260809 06:52:29.332127 15435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:29.333417 15419 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:29.333604 15419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "c2d8a92b9051405f9f527631854bdf83"
format_stamp: "Formatted at 2026-08-09 06:52:29 on dist-test-slave-0b58"
server_key: "26dba61461cef63df95abdd08abf7c36"
server_key_iv: "93cf4fcd8f2be5ab2d935b3adfc4f7af"
server_key_version: "encryptionkey@0"
I20260809 06:52:29.333832 15419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:29.365372 15419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:29.369503 15419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:29.369797 15419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:29.388420 15419 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:40373
I20260809 06:52:29.388453 15489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:40373 every 8 connection(s)
I20260809 06:52:29.389334 15419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:29.392942 15490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:29.399034 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 15419
I20260809 06:52:29.399251 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:29.399899 11061 external_mini_cluster.cc:1428] Setting key 0cf18c3e4be4dc17d37097faa095561c
I20260809 06:52:29.403733 15490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83: Bootstrap starting.
I20260809 06:52:29.407518 15490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:29.408631 15490 log.cc:824] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:29.411721 15490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83: No bootstrap required, opened a new log
Aug 09 06:52:29 dist-test-slave-0b58 krb5kdc[15404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:29.420461 15490 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d8a92b9051405f9f527631854bdf83" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40373 } }
I20260809 06:52:29.420854 15490 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:29.420979 15490 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2d8a92b9051405f9f527631854bdf83, State: Initialized, Role: FOLLOWER
I20260809 06:52:29.421633 15490 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d8a92b9051405f9f527631854bdf83" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40373 } }
I20260809 06:52:29.421880 15490 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:29.422029 15490 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:29.422242 15490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:29.424192 15493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:29.401958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53154 (local address 127.10.205.126:40373)
0809 06:52:29.402710 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:29.402722 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:29.402763 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:52:29.404590 (+ 1827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:29.404613 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:29.404983 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:29.405305 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:29.407298 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:29.408776 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:29.410429 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:29.411082 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:29.411208 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:29.416035 (+ 4827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:29.416043 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:29.416061 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:29.416103 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:29.419353 (+ 3250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:29.420064 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:29.420072 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:29.420078 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:29.420301 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:29.420686 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:29.420691 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:29.420695 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:29.421405 (+ 710us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:29.421700 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:29.422295 (+ 595us) server_negotiation.cc:299] Negotiation successful
0809 06:52:29.422742 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":345,"threads_started":1}
I20260809 06:52:29.425391 15490 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d8a92b9051405f9f527631854bdf83" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40373 } }
I20260809 06:52:29.425884 15490 leader_election.cc:302] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2d8a92b9051405f9f527631854bdf83; no voters:
I20260809 06:52:29.426541 15490 leader_election.cc:288] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:29.426683 15496 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:29.427908 15496 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [term 1 LEADER]: Becoming Leader. State: Replica: c2d8a92b9051405f9f527631854bdf83, State: Running, Role: LEADER
I20260809 06:52:29.428428 15496 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d8a92b9051405f9f527631854bdf83" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40373 } }
I20260809 06:52:29.428742 15490 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:29.431504 15497 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2d8a92b9051405f9f527631854bdf83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d8a92b9051405f9f527631854bdf83" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40373 } } }
I20260809 06:52:29.431867 15497 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:29.432315 15498 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2d8a92b9051405f9f527631854bdf83. Latest consensus state: current_term: 1 leader_uuid: "c2d8a92b9051405f9f527631854bdf83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2d8a92b9051405f9f527631854bdf83" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40373 } } }
I20260809 06:52:29.432619 15498 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:29.437143 15503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:29.442952 15503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:29.452069 15503 catalog_manager.cc:1347] Generated new cluster ID: 48be6cc478724dce8842101d171396b2
I20260809 06:52:29.452186 15503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:29.469962 15503 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:29.471896 15503 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:29.490795 15503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83: Generated new TSK 0
I20260809 06:52:29.491878 15503 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:52:29.548236 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:40373
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:29.884878 15518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:29.885190 15518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:29.885386 15518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:29.892879 15518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:29.893028 15518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:29.893211 15518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:52:29.903193 15518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:40373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:29.904633 15518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:29.906175 15518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:29.919346 15527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:29.919413 15525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:29.919844 15524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:29.920523 15518 server_base.cc:1034] running on GCE node
I20260809 06:52:29.921128 15518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:29.922081 15518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:29.923274 15518 hybrid_clock.cc:648] HybridClock initialized: now 1786258349923212 us; error 53 us; skew 500 ppm
I20260809 06:52:29.923556 15518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:29 dist-test-slave-0b58 krb5kdc[15404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258349, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:29.926908 15518 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:52:29.927999 15518 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:29.928089 15518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:29.928433 15518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:29.931571 15518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "36cbe24e958049c1bec3093c30b5783b"
format_stamp: "Formatted at 2026-08-09 06:52:29 on dist-test-slave-0b58"
server_key: "b777ac4fb41dcc95e2ff6b1cd9f539ad"
server_key_iv: "23c9b4f5cac32c3bdd87088f1ae12cad"
server_key_version: "encryptionkey@0"
I20260809 06:52:29.932404 15518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "36cbe24e958049c1bec3093c30b5783b"
format_stamp: "Formatted at 2026-08-09 06:52:29 on dist-test-slave-0b58"
server_key: "b777ac4fb41dcc95e2ff6b1cd9f539ad"
server_key_iv: "23c9b4f5cac32c3bdd87088f1ae12cad"
server_key_version: "encryptionkey@0"
I20260809 06:52:29.937633 15518 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 06:52:29.941314 15533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:29.942605 15518 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:52:29.942737 15518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "36cbe24e958049c1bec3093c30b5783b"
format_stamp: "Formatted at 2026-08-09 06:52:29 on dist-test-slave-0b58"
server_key: "b777ac4fb41dcc95e2ff6b1cd9f539ad"
server_key_iv: "23c9b4f5cac32c3bdd87088f1ae12cad"
server_key_version: "encryptionkey@0"
I20260809 06:52:29.942929 15518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:29.958240 15518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:29.962687 15518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:29.962946 15518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:29.963855 15518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:29.965176 15518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:29.965265 15518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:29.965342 15518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:29.965397 15518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:29.998324 15518 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:42883
I20260809 06:52:29.998415 15655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:42883 every 8 connection(s)
I20260809 06:52:29.999234 15518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:52:30.002080 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 15518
I20260809 06:52:30.002296 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:52:30.003211 11061 external_mini_cluster.cc:1428] Setting key 9d5d86659e37e6bfc8d54136f3df1387
Aug 09 06:52:30 dist-test-slave-0b58 krb5kdc[15404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258349, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:30.022148 15658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:30.001782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:46741 (local address 127.10.205.126:40373)
0809 06:52:30.002295 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:30.002300 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:30.003541 (+ 1241us) server_negotiation.cc:407] Connection header received
0809 06:52:30.005962 (+ 2421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:30.005967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:30.006057 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:30.006188 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:30.007760 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:30.008556 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:30.010162 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:30.010567 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:30.010707 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:30.014764 (+ 4057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:30.014773 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:30.014782 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:30.014839 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:30.018634 (+ 3795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:30.019428 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:30.019437 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:30.019443 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:30.019606 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:30.020013 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:30.020021 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:30.020026 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:30.020455 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:30.020626 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:30.021350 (+ 724us) server_negotiation.cc:299] Negotiation successful
0809 06:52:30.021645 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":269,"threads_started":1}
I20260809 06:52:30.022787 15660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:30.002511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:40373 (local address 127.10.205.65:46741)
0809 06:52:30.003369 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:30.003418 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:30.005687 (+ 2269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:30.006440 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:30.006449 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:30.006998 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:30.007586 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:30.007603 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:30.008725 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:30.008729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:30.009992 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:30.010004 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:30.010811 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:30.010821 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:30.011064 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:30.011791 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:30.011821 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:30.014492 (+ 2671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:30.018812 (+ 4320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:30.018819 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:30.018835 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:30.019304 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:30.019717 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:30.019720 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:30.019722 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:30.019901 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:30.020573 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:30.020579 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:30.020942 (+ 363us) client_negotiation.cc:769] Sending connection context
0809 06:52:30.021205 (+ 263us) client_negotiation.cc:240] Negotiation successful
0809 06:52:30.021632 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":341,"threads_started":1}
I20260809 06:52:30.024441 15656 heartbeater.cc:347] Connected to a master server at 127.10.205.126:40373
I20260809 06:52:30.024749 15656 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:30.025484 15656 heartbeater.cc:511] Master 127.10.205.126:40373 requested a full tablet report, sending...
I20260809 06:52:30.027635 15453 ts_manager.cc:194] Registered new tserver with Master: 36cbe24e958049c1bec3093c30b5783b (127.10.205.65:42883)
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
I20260809 06:52:30.029376 15453 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:46741
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:52:30.059651 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:40373
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:30.419924 15664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:30.420230 15664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:30.420459 15664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:30.427909 15664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:30.428025 15664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:30.428224 15664 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:52:30.438560 15664 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:40373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:30.440024 15664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:30.441593 15664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:30.454984 15669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:30.454938 15672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:30.454910 15670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:30.456009 15664 server_base.cc:1034] running on GCE node
I20260809 06:52:30.456722 15664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:30.457775 15664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:30.458981 15664 hybrid_clock.cc:648] HybridClock initialized: now 1786258350458939 us; error 36 us; skew 500 ppm
I20260809 06:52:30.459317 15664 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:30 dist-test-slave-0b58 krb5kdc[15404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:30.462584 15664 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:52:30.463889 15664 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:30.464017 15664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:30.464403 15664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:30.467474 15664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "a21a5f746d324d838809895f3aa5b5da"
format_stamp: "Formatted at 2026-08-09 06:52:30 on dist-test-slave-0b58"
server_key: "9012fbf09d012941233560065df8630f"
server_key_iv: "5b4c37603a31d5a6b9a8e9411c01e853"
server_key_version: "encryptionkey@0"
I20260809 06:52:30.468405 15664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "a21a5f746d324d838809895f3aa5b5da"
format_stamp: "Formatted at 2026-08-09 06:52:30 on dist-test-slave-0b58"
server_key: "9012fbf09d012941233560065df8630f"
server_key_iv: "5b4c37603a31d5a6b9a8e9411c01e853"
server_key_version: "encryptionkey@0"
I20260809 06:52:30.473781 15664 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:52:30.477496 15678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:30.478878 15664 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:30.479074 15664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "a21a5f746d324d838809895f3aa5b5da"
format_stamp: "Formatted at 2026-08-09 06:52:30 on dist-test-slave-0b58"
server_key: "9012fbf09d012941233560065df8630f"
server_key_iv: "5b4c37603a31d5a6b9a8e9411c01e853"
server_key_version: "encryptionkey@0"
I20260809 06:52:30.479305 15664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:30.495731 15664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:30.499913 15664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:30.500231 15664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:30.501274 15664 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:30.502676 15664 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:30.502807 15664 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:30.502928 15664 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:30.503015 15664 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:30.536080 15664 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:46357
I20260809 06:52:30.536170 15794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:46357 every 8 connection(s)
I20260809 06:52:30.537117 15664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:52:30.545399 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 15664
I20260809 06:52:30.545581 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:52:30.546181 11061 external_mini_cluster.cc:1428] Setting key ba38d1dab72b036b091f4a2c77d24925
Aug 09 06:52:30 dist-test-slave-0b58 krb5kdc[15404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:30.559013 15797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:30.539646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:52771 (local address 127.10.205.126:40373)
0809 06:52:30.540100 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:30.540107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:30.541200 (+ 1093us) server_negotiation.cc:407] Connection header received
0809 06:52:30.543015 (+ 1815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:30.543019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:30.543091 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:30.543189 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:30.544734 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:30.545749 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:30.547770 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:30.548342 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:30.548481 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:30.552110 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:30.552119 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:30.552127 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:30.552175 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:30.555768 (+ 3593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:30.556569 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:30.556578 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:30.556584 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:30.556748 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:30.557185 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:30.557189 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:30.557191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:30.557477 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:30.557641 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:30.558390 (+ 749us) server_negotiation.cc:299] Negotiation successful
0809 06:52:30.558624 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":210,"threads_started":1}
I20260809 06:52:30.560022 15798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:30.540311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:40373 (local address 127.10.205.66:52771)
0809 06:52:30.541041 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:30.541085 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:30.542757 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:30.543401 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:30.543409 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:30.543927 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:30.544572 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:30.544591 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:30.545946 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:30.545951 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:30.547612 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:30.547624 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:30.548553 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:30.548558 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:30.548741 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:30.549439 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:30.549467 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:30.551858 (+ 2391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:30.555914 (+ 4056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:30.555921 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:30.555934 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:30.556457 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:30.556873 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:30.556877 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:30.556879 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:30.557053 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:30.557612 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:30.557621 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:30.557987 (+ 366us) client_negotiation.cc:769] Sending connection context
0809 06:52:30.558260 (+ 273us) client_negotiation.cc:240] Negotiation successful
0809 06:52:30.558834 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":288,"threads_started":1}
I20260809 06:52:30.561488 15795 heartbeater.cc:347] Connected to a master server at 127.10.205.126:40373
I20260809 06:52:30.561794 15795 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:30.562475 15795 heartbeater.cc:511] Master 127.10.205.126:40373 requested a full tablet report, sending...
I20260809 06:52:30.563977 15453 ts_manager.cc:194] Registered new tserver with Master: a21a5f746d324d838809895f3aa5b5da (127.10.205.66:46357)
I20260809 06:52:30.565353 15453 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:52771
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:52:30.600412 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:40373
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:30.938293 15802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:30.938644 15802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:30.938831 15802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:30.946214 15802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:30.946344 15802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:30.946530 15802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:52:30.956422 15802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:40373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:30.957819 15802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:30.959185 15802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:30.972151 15807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:30.972103 15810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:30.972066 15808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:30.973335 15802 server_base.cc:1034] running on GCE node
I20260809 06:52:30.973956 15802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:30.974861 15802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:30.976059 15802 hybrid_clock.cc:648] HybridClock initialized: now 1786258350976003 us; error 58 us; skew 500 ppm
I20260809 06:52:30.976423 15802 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:30 dist-test-slave-0b58 krb5kdc[15404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:30.979643 15802 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:52:30.980805 15802 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:30.980918 15802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:30.981256 15802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:30.984364 15802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e"
format_stamp: "Formatted at 2026-08-09 06:52:30 on dist-test-slave-0b58"
server_key: "f16c477fe675f918422f454e182fe289"
server_key_iv: "8be8185b7af4613190bddb4c3227ccf4"
server_key_version: "encryptionkey@0"
I20260809 06:52:30.985266 15802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e"
format_stamp: "Formatted at 2026-08-09 06:52:30 on dist-test-slave-0b58"
server_key: "f16c477fe675f918422f454e182fe289"
server_key_iv: "8be8185b7af4613190bddb4c3227ccf4"
server_key_version: "encryptionkey@0"
I20260809 06:52:30.990329 15802 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:52:30.993691 15816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:30.995043 15802 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:52:30.995223 15802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e"
format_stamp: "Formatted at 2026-08-09 06:52:30 on dist-test-slave-0b58"
server_key: "f16c477fe675f918422f454e182fe289"
server_key_iv: "8be8185b7af4613190bddb4c3227ccf4"
server_key_version: "encryptionkey@0"
I20260809 06:52:30.995446 15802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:31.010126 15802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:31.014026 15802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:31.014307 15802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:31.015231 15802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:31.016608 15802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:31.016716 15802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:31.016849 15802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:31.016930 15802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:31.032542 15656 heartbeater.cc:503] Master 127.10.205.126:40373 was elected leader, sending a full tablet report...
I20260809 06:52:31.050843 15802 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:41391
I20260809 06:52:31.050900 15932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:41391 every 8 connection(s)
I20260809 06:52:31.051720 15802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:52:31.053440 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 15802
I20260809 06:52:31.053640 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:52:31.054096 11061 external_mini_cluster.cc:1428] Setting key db466d55cc5fd33268056f643205c8a3
Aug 09 06:52:31 dist-test-slave-0b58 krb5kdc[15404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258350, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:31.071341 15797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.054317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:37087 (local address 127.10.205.126:40373)
0809 06:52:31.054557 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:31.054565 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:31.056041 (+ 1476us) server_negotiation.cc:407] Connection header received
0809 06:52:31.058058 (+ 2017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:31.058062 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:31.058143 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:31.058231 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:31.059633 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.060463 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.061954 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.062333 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.062428 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.065690 (+ 3262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:31.065695 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:31.065698 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:31.065730 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:31.068382 (+ 2652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:31.069190 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:31.069195 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:31.069198 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:31.069358 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:31.069872 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:31.069876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:31.069879 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:31.070186 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:31.070312 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:31.070926 (+ 614us) server_negotiation.cc:299] Negotiation successful
0809 06:52:31.071093 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 06:52:31.072359 15935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.054935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:40373 (local address 127.10.205.67:37087)
0809 06:52:31.055862 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:31.055916 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:31.057811 (+ 1895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:31.058431 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:31.058439 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:31.058944 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:31.059493 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:31.059511 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.060586 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.060589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:31.061817 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:31.061829 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.062519 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.062524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:31.062709 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.063325 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:31.063350 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:31.065497 (+ 2147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:31.068510 (+ 3013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:31.068517 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:31.068529 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:31.069078 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:31.069468 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:31.069472 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:31.069476 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:31.069750 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:31.070304 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:31.070309 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:31.070612 (+ 303us) client_negotiation.cc:769] Sending connection context
0809 06:52:31.070848 (+ 236us) client_negotiation.cc:240] Negotiation successful
0809 06:52:31.071226 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":407,"threads_started":1}
I20260809 06:52:31.073689 15933 heartbeater.cc:347] Connected to a master server at 127.10.205.126:40373
I20260809 06:52:31.073980 15933 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:31.074630 15933 heartbeater.cc:511] Master 127.10.205.126:40373 requested a full tablet report, sending...
I20260809 06:52:31.075932 15453 ts_manager.cc:194] Registered new tserver with Master: ddfb55ed52eb4b8fb8449bd4aef4a22e (127.10.205.67:41391)
I20260809 06:52:31.076766 15453 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:37087
I20260809 06:52:31.081851 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:52:31.099105 15797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.086477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45542 (local address 127.10.205.126:40373)
0809 06:52:31.086641 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:31.086645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:31.087161 (+ 516us) server_negotiation.cc:407] Connection header received
0809 06:52:31.087366 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:31.087371 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:31.087450 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:31.087547 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:31.089049 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.089767 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.091048 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.091458 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.091582 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.093823 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:31.093829 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:31.093838 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:31.093869 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:31.096423 (+ 2554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:31.097042 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:31.097049 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:31.097052 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:31.097200 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:31.097567 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:31.097574 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:31.097578 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:31.097917 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:31.098192 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:31.098539 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 06:52:31.098766 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 06:52:31.103034 15453 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:52:31.109961 15453 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:31.144371 15949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.122052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:41391 (local address 127.0.0.1:56472)
0809 06:52:31.134571 (+ 12519us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:31.134613 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:31.134830 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:31.136449 (+ 1619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:31.136453 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:31.136469 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:31.136987 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:31.137006 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.139765 (+ 2759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.139772 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:31.141554 (+ 1782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:31.141567 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.143314 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.143321 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:31.143513 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.143579 (+ 66us) client_negotiation.cc:769] Sending connection context
0809 06:52:31.143705 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 06:52:31.143904 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12201,"mutex_wait_us":3,"thread_start_us":12256,"threads_started":1}
I20260809 06:52:31.144527 15947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.122322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56472 (local address 127.10.205.67:41391)
0809 06:52:31.135412 (+ 13090us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:31.135422 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:31.135458 (+ 36us) server_negotiation.cc:407] Connection header received
0809 06:52:31.135564 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:31.135572 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:31.135828 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:31.136020 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:31.137765 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.139599 (+ 1834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.141713 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.143115 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.143255 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.143511 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:31.143973 (+ 462us) server_negotiation.cc:299] Negotiation successful
0809 06:52:31.144147 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12918,"thread_start_us":12754,"threads_started":1}
I20260809 06:52:31.144676 15950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.122784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55872 (local address 127.10.205.65:42883)
0809 06:52:31.133811 (+ 11027us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:31.133826 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:31.134840 (+ 1014us) server_negotiation.cc:407] Connection header received
0809 06:52:31.135607 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:31.135614 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:31.135843 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:31.136006 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:31.137697 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.139274 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.142023 (+ 2749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.143484 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.143596 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.143836 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:31.144097 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 06:52:31.144319 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10763,"thread_start_us":11061,"threads_started":1}
I20260809 06:52:31.145570 15952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.136346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:46357 (local address 127.0.0.1:56848)
0809 06:52:31.137130 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:31.137149 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:31.137251 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:31.137993 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:31.137997 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:31.138023 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:31.138659 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:31.138671 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.140479 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.140485 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:31.142666 (+ 2181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:31.142683 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.144832 (+ 2149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.144842 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:31.145036 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.145072 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:52:31.145175 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 06:52:31.145276 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":478,"threads_started":1}
I20260809 06:52:31.146150 15951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.135518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56848 (local address 127.10.205.66:46357)
0809 06:52:31.137472 (+ 1954us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:31.137477 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:31.137498 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:52:31.137571 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:31.137576 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:31.137785 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:31.137992 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:31.138849 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.140338 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.142857 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.144328 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.144463 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.144661 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:31.145624 (+ 963us) server_negotiation.cc:299] Negotiation successful
0809 06:52:31.145810 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1802,"thread_start_us":1655,"threads_started":1}
I20260809 06:52:31.145721 15946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.122314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:42883 (local address 127.0.0.1:55872)
0809 06:52:31.134670 (+ 12356us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:31.134696 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:31.135388 (+ 692us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:31.136408 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:31.136421 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:31.136452 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:31.137523 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:31.137534 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.139462 (+ 1928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.139467 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:31.141825 (+ 2358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:31.141839 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.143721 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.143726 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:31.143885 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.143914 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 06:52:31.145102 (+ 1188us) client_negotiation.cc:240] Negotiation successful
0809 06:52:31.145245 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12174,"mutex_wait_us":508,"thread_start_us":12670,"threads_started":1}
I20260809 06:52:31.148941 15866 tablet_service.cc:1467] Processing CreateTablet for tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea (DEFAULT_TABLE table=test-table [id=fc229a5a85954c3a8ab3ba2d16caaf48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:31.149503 15728 tablet_service.cc:1467] Processing CreateTablet for tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea (DEFAULT_TABLE table=test-table [id=fc229a5a85954c3a8ab3ba2d16caaf48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:31.150234 15866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:31.150844 15728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:31.150713 15588 tablet_service.cc:1467] Processing CreateTablet for tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea (DEFAULT_TABLE table=test-table [id=fc229a5a85954c3a8ab3ba2d16caaf48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:31.152061 15588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:31.161756 15953 tablet_bootstrap.cc:492] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e: Bootstrap starting.
I20260809 06:52:31.165294 15953 tablet_bootstrap.cc:654] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:31.166360 15954 tablet_bootstrap.cc:492] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da: Bootstrap starting.
I20260809 06:52:31.166951 15953 log.cc:824] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:31.167941 15955 tablet_bootstrap.cc:492] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b: Bootstrap starting.
I20260809 06:52:31.170173 15954 tablet_bootstrap.cc:654] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:31.170960 15955 tablet_bootstrap.cc:654] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:31.171350 15953 tablet_bootstrap.cc:492] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e: No bootstrap required, opened a new log
I20260809 06:52:31.171473 15954 log.cc:824] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:31.171633 15953 ts_tablet_manager.cc:1397] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 06:52:31.172055 15955 log.cc:824] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:31.174539 15954 tablet_bootstrap.cc:492] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da: No bootstrap required, opened a new log
I20260809 06:52:31.174806 15954 ts_tablet_manager.cc:1397] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260809 06:52:31.175144 15955 tablet_bootstrap.cc:492] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b: No bootstrap required, opened a new log
I20260809 06:52:31.175413 15955 ts_tablet_manager.cc:1397] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s
I20260809 06:52:31.181732 15954 raft_consensus.cc:348] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41391 } } peers { permanent_uuid: "36cbe24e958049c1bec3093c30b5783b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42883 } } peers { permanent_uuid: "a21a5f746d324d838809895f3aa5b5da" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 46357 } }
I20260809 06:52:31.182166 15954 raft_consensus.cc:374] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:31.182294 15954 raft_consensus.cc:729] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a21a5f746d324d838809895f3aa5b5da, State: Initialized, Role: FOLLOWER
I20260809 06:52:31.183007 15954 consensus_queue.cc:260] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41391 } } peers { permanent_uuid: "36cbe24e958049c1bec3093c30b5783b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42883 } } peers { permanent_uuid: "a21a5f746d324d838809895f3aa5b5da" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 46357 } }
I20260809 06:52:31.182951 15953 raft_consensus.cc:348] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41391 } } peers { permanent_uuid: "36cbe24e958049c1bec3093c30b5783b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42883 } } peers { permanent_uuid: "a21a5f746d324d838809895f3aa5b5da" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 46357 } }
I20260809 06:52:31.183394 15953 raft_consensus.cc:374] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:31.183488 15953 raft_consensus.cc:729] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfb55ed52eb4b8fb8449bd4aef4a22e, State: Initialized, Role: FOLLOWER
I20260809 06:52:31.184069 15953 consensus_queue.cc:260] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41391 } } peers { permanent_uuid: "36cbe24e958049c1bec3093c30b5783b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42883 } } peers { permanent_uuid: "a21a5f746d324d838809895f3aa5b5da" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 46357 } }
I20260809 06:52:31.186848 15955 raft_consensus.cc:348] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41391 } } peers { permanent_uuid: "36cbe24e958049c1bec3093c30b5783b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42883 } } peers { permanent_uuid: "a21a5f746d324d838809895f3aa5b5da" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 46357 } }
I20260809 06:52:31.187403 15955 raft_consensus.cc:374] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:31.187523 15955 raft_consensus.cc:729] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36cbe24e958049c1bec3093c30b5783b, State: Initialized, Role: FOLLOWER
I20260809 06:52:31.188140 15955 consensus_queue.cc:260] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41391 } } peers { permanent_uuid: "36cbe24e958049c1bec3093c30b5783b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42883 } } peers { permanent_uuid: "a21a5f746d324d838809895f3aa5b5da" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 46357 } }
I20260809 06:52:31.188361 15933 heartbeater.cc:503] Master 127.10.205.126:40373 was elected leader, sending a full tablet report...
I20260809 06:52:31.189647 15953 ts_tablet_manager.cc:1428] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e: Time spent starting tablet: real 0.018s user 0.008s sys 0.010s
I20260809 06:52:31.190712 15795 heartbeater.cc:503] Master 127.10.205.126:40373 was elected leader, sending a full tablet report...
I20260809 06:52:31.191274 15954 ts_tablet_manager.cc:1428] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s
I20260809 06:52:31.192730 15955 ts_tablet_manager.cc:1428] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b: Time spent starting tablet: real 0.017s user 0.013s sys 0.005s
W20260809 06:52:31.251828 15657 tablet.cc:2369] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:52:31.289490 15796 tablet.cc:2369] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:52:31.303445 15934 tablet.cc:2369] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:52:31.309118 15961 raft_consensus.cc:482] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:31.309552 15961 raft_consensus.cc:504] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41391 } } peers { permanent_uuid: "36cbe24e958049c1bec3093c30b5783b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42883 } } peers { permanent_uuid: "a21a5f746d324d838809895f3aa5b5da" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 46357 } }
I20260809 06:52:31.312356 15961 leader_election.cc:288] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36cbe24e958049c1bec3093c30b5783b (127.10.205.65:42883), a21a5f746d324d838809895f3aa5b5da (127.10.205.66:46357)
I20260809 06:52:31.323935 15935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.313246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:42883 (local address 127.10.205.67:60409)
0809 06:52:31.313932 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:31.313970 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:31.314310 (+ 340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:31.314929 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:31.314935 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:31.314969 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:31.315352 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:31.315390 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.317773 (+ 2383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.317780 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:31.320618 (+ 2838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:31.320644 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.322636 (+ 1992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.322645 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:31.322999 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.323087 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 06:52:31.323250 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 06:52:31.323496 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":105}
I20260809 06:52:31.324054 15950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.313040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:60409 (local address 127.10.205.65:42883)
0809 06:52:31.313482 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:31.313500 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:31.314160 (+ 660us) server_negotiation.cc:407] Connection header received
0809 06:52:31.314549 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:31.314565 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:31.314719 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:31.314894 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:31.315644 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.317586 (+ 1942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.320850 (+ 3264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.322387 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.322595 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.322677 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:31.323272 (+ 595us) server_negotiation.cc:299] Negotiation successful
0809 06:52:31.323537 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155}
I20260809 06:52:31.324967 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.313486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:46357 (local address 127.10.205.67:39307)
0809 06:52:31.314680 (+ 1194us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:31.314714 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:31.314942 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:31.315595 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:31.315600 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:31.315658 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:31.316493 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:31.316528 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.318566 (+ 2038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.318579 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:31.321293 (+ 2714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:31.321321 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.323323 (+ 2002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.323331 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:31.323672 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.323760 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 06:52:31.323958 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 06:52:31.324217 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":988,"mutex_wait_us":59,"thread_start_us":743,"threads_started":1}
I20260809 06:52:31.324978 15951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.313477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:39307 (local address 127.10.205.66:46357)
0809 06:52:31.313769 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:31.313774 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:31.314871 (+ 1097us) server_negotiation.cc:407] Connection header received
0809 06:52:31.315166 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:31.315174 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:31.315326 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:31.315556 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:31.316829 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.318303 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.321519 (+ 3216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.322995 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.323267 (+ 272us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.323390 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:31.324041 (+ 651us) server_negotiation.cc:299] Negotiation successful
0809 06:52:31.324644 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 06:52:31.326128 15609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52f0c7dac61a4da1a4eb26a41b2bb3ea" candidate_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36cbe24e958049c1bec3093c30b5783b" is_pre_election: true
I20260809 06:52:31.326987 15749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52f0c7dac61a4da1a4eb26a41b2bb3ea" candidate_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21a5f746d324d838809895f3aa5b5da" is_pre_election: true
I20260809 06:52:31.327283 15609 raft_consensus.cc:2454] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfb55ed52eb4b8fb8449bd4aef4a22e in term 0.
I20260809 06:52:31.328006 15749 raft_consensus.cc:2454] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfb55ed52eb4b8fb8449bd4aef4a22e in term 0.
I20260809 06:52:31.328943 15817 leader_election.cc:302] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36cbe24e958049c1bec3093c30b5783b, ddfb55ed52eb4b8fb8449bd4aef4a22e; no voters:
I20260809 06:52:31.329686 15961 raft_consensus.cc:2781] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:31.329989 15961 raft_consensus.cc:482] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:31.330180 15961 raft_consensus.cc:3037] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:31.333906 15961 raft_consensus.cc:504] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41391 } } peers { permanent_uuid: "36cbe24e958049c1bec3093c30b5783b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42883 } } peers { permanent_uuid: "a21a5f746d324d838809895f3aa5b5da" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 46357 } }
I20260809 06:52:31.335052 15961 leader_election.cc:288] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [CANDIDATE]: Term 1 election: Requested vote from peers 36cbe24e958049c1bec3093c30b5783b (127.10.205.65:42883), a21a5f746d324d838809895f3aa5b5da (127.10.205.66:46357)
I20260809 06:52:31.335810 15609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52f0c7dac61a4da1a4eb26a41b2bb3ea" candidate_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36cbe24e958049c1bec3093c30b5783b"
I20260809 06:52:31.336022 15749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52f0c7dac61a4da1a4eb26a41b2bb3ea" candidate_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21a5f746d324d838809895f3aa5b5da"
I20260809 06:52:31.336133 15609 raft_consensus.cc:3037] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:31.336407 15749 raft_consensus.cc:3037] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:31.340838 15749 raft_consensus.cc:2454] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfb55ed52eb4b8fb8449bd4aef4a22e in term 1.
I20260809 06:52:31.341070 15609 raft_consensus.cc:2454] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfb55ed52eb4b8fb8449bd4aef4a22e in term 1.
I20260809 06:52:31.341782 15818 leader_election.cc:302] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a21a5f746d324d838809895f3aa5b5da, ddfb55ed52eb4b8fb8449bd4aef4a22e; no voters:
I20260809 06:52:31.342392 15961 raft_consensus.cc:2781] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:31.343116 15961 raft_consensus.cc:686] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 1 LEADER]: Becoming Leader. State: Replica: ddfb55ed52eb4b8fb8449bd4aef4a22e, State: Running, Role: LEADER
I20260809 06:52:31.344120 15961 consensus_queue.cc:237] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41391 } } peers { permanent_uuid: "36cbe24e958049c1bec3093c30b5783b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42883 } } peers { permanent_uuid: "a21a5f746d324d838809895f3aa5b5da" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 46357 } }
I20260809 06:52:31.351897 15452 catalog_manager.cc:5495] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfb55ed52eb4b8fb8449bd4aef4a22e (127.10.205.67). New cstate: current_term: 1 leader_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddfb55ed52eb4b8fb8449bd4aef4a22e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36cbe24e958049c1bec3093c30b5783b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a21a5f746d324d838809895f3aa5b5da" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 46357 } health_report { overall_health: UNKNOWN } } }
I20260809 06:52:31.399132 15947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.389581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56482 (local address 127.10.205.67:41391)
0809 06:52:31.389920 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:31.389937 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:31.390207 (+ 270us) server_negotiation.cc:407] Connection header received
0809 06:52:31.390628 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:31.390642 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:31.390775 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:31.391033 (+ 258us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:31.391710 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.392980 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.395228 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.395912 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.396151 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.397079 (+ 928us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:31.397963 (+ 884us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:31.398335 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:31.398443 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 06:52:31.398573 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 06:52:31.413663 15749 raft_consensus.cc:1261] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da [term 1 FOLLOWER]: Refusing update from remote peer ddfb55ed52eb4b8fb8449bd4aef4a22e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:31.413664 15609 raft_consensus.cc:1261] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b [term 1 FOLLOWER]: Refusing update from remote peer ddfb55ed52eb4b8fb8449bd4aef4a22e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:31.415844 15964 consensus_queue.cc:1035] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a21a5f746d324d838809895f3aa5b5da" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 46357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:31.416460 15961 consensus_queue.cc:1035] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36cbe24e958049c1bec3093c30b5783b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:31.437170 15967 mvcc.cc:205] Tried to move back new op lower bound from 7316514207371464704 to 7316514207113256960. Current Snapshot: MvccSnapshot[applied={T|T < 7316514207371464704}]
I20260809 06:52:31.464371 15451 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:31.464991 15451 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:31.471475 15451 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c2d8a92b9051405f9f527631854bdf83: Sending DeleteTablet for 3 replicas of tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea
I20260809 06:52:31.473685 15866 tablet_service.cc:1514] Processing DeleteTablet for tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:31 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:56472
I20260809 06:52:31.473816 15588 tablet_service.cc:1514] Processing DeleteTablet for tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:31 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:55872
I20260809 06:52:31.474442 15728 tablet_service.cc:1514] Processing DeleteTablet for tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:31 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:56848
I20260809 06:52:31.478263 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 15518
I20260809 06:52:31.490888 15978 tablet_replica.cc:330] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e: stopping tablet replica
I20260809 06:52:31.491911 15978 raft_consensus.cc:2229] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:31.493306 15978 raft_consensus.cc:2258] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:31.499370 15978 ts_tablet_manager.cc:1905] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:31.505379 15980 tablet_replica.cc:330] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da: stopping tablet replica
I20260809 06:52:31.506319 15980 raft_consensus.cc:2229] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:31.507243 15980 raft_consensus.cc:2258] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:31.509071 15979 tablet_replica.cc:330] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b: stopping tablet replica
I20260809 06:52:31.509950 15979 raft_consensus.cc:2229] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:31.510846 15979 raft_consensus.cc:2258] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:31.518815 15980 ts_tablet_manager.cc:1905] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:31.522297 15978 ts_tablet_manager.cc:1918] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:31.522643 15978 log.cc:1196] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/52f0c7dac61a4da1a4eb26a41b2bb3ea
Aug 09 06:52:31 dist-test-slave-0b58 krb5kdc[15404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:52:31.523723 15978 ts_tablet_manager.cc:1939] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P ddfb55ed52eb4b8fb8449bd4aef4a22e: Deleting consensus metadata
I20260809 06:52:31.526826 15979 ts_tablet_manager.cc:1905] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:31.528432 15437 catalog_manager.cc:4841] TS ddfb55ed52eb4b8fb8449bd4aef4a22e (127.10.205.67:41391): tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea (table test-table [id=fc229a5a85954c3a8ab3ba2d16caaf48]) successfully deleted
I20260809 06:52:31.533468 15980 ts_tablet_manager.cc:1918] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:31.533829 15980 log.cc:1196] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/52f0c7dac61a4da1a4eb26a41b2bb3ea
I20260809 06:52:31.534936 15980 ts_tablet_manager.cc:1939] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P a21a5f746d324d838809895f3aa5b5da: Deleting consensus metadata
I20260809 06:52:31.539289 15437 catalog_manager.cc:4841] TS a21a5f746d324d838809895f3aa5b5da (127.10.205.66:46357): tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea (table test-table [id=fc229a5a85954c3a8ab3ba2d16caaf48]) successfully deleted
I20260809 06:52:31.541011 15979 ts_tablet_manager.cc:1918] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:31.541417 15979 log.cc:1196] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/52f0c7dac61a4da1a4eb26a41b2bb3ea
I20260809 06:52:31.542439 15979 ts_tablet_manager.cc:1939] T 52f0c7dac61a4da1a4eb26a41b2bb3ea P 36cbe24e958049c1bec3093c30b5783b: Deleting consensus metadata
I20260809 06:52:31.546131 15436 catalog_manager.cc:4841] TS 36cbe24e958049c1bec3093c30b5783b (127.10.205.65:42883): tablet 52f0c7dac61a4da1a4eb26a41b2bb3ea (table test-table [id=fc229a5a85954c3a8ab3ba2d16caaf48]) successfully deleted
I20260809 06:52:31.548543 15950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.481837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55878 (local address 127.10.205.65:42883)
0809 06:52:31.482415 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:31.482425 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:31.494839 (+ 12414us) server_negotiation.cc:407] Connection header received
0809 06:52:31.495224 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:31.495232 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:31.495416 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:31.495609 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:31.505201 (+ 9592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.507179 (+ 1978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.512311 (+ 5132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.513685 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.513888 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.525797 (+ 11909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:31.525827 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:31.525860 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:31.525954 (+ 94us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:31.541030 (+ 15076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:31.543056 (+ 2026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:31.543068 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:31.543072 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:31.543439 (+ 367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:31.544559 (+ 1120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:31.544568 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:31.544584 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:31.545390 (+ 806us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:31.547028 (+ 1638us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:31.547359 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 06:52:31.547781 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165}
I20260809 06:52:31.549985 15651 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:31.715001 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 15518
I20260809 06:52:31.744666 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 15664
Aug 09 06:52:31 dist-test-slave-0b58 krb5kdc[15404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:52:31.769068 15951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.745841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56862 (local address 127.10.205.66:46357)
0809 06:52:31.746159 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:31.746175 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:31.746211 (+ 36us) server_negotiation.cc:407] Connection header received
0809 06:52:31.746528 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:31.746540 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:31.746643 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:31.746807 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:31.748690 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.749654 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.751470 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.752132 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.752408 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:31.759594 (+ 7186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:31.759621 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:31.759649 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:31.759707 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:31.764060 (+ 4353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:31.765504 (+ 1444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:31.765517 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:31.765519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:31.765715 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:31.766369 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:31.766372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:31.766378 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:31.766958 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:31.767301 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:31.767984 (+ 683us) server_negotiation.cc:299] Negotiation successful
0809 06:52:31.768424 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260809 06:52:31.770164 15790 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:31.949265 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 15664
I20260809 06:52:31.981993 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 15802
Aug 09 06:52:31 dist-test-slave-0b58 krb5kdc[15404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:52:32.014221 15984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:31.983648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56484 (local address 127.10.205.67:41391)
0809 06:52:31.984896 (+ 1248us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:31.984918 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:31.985000 (+ 82us) server_negotiation.cc:407] Connection header received
0809 06:52:31.985138 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:31.985145 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:31.985343 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:31.985605 (+ 262us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:31.988209 (+ 2604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.989658 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.991926 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:31.993071 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:31.993482 (+ 411us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:32.003343 (+ 9861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:32.003367 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:32.003400 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:32.003483 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:32.009375 (+ 5892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:32.010887 (+ 1512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:32.010904 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:32.010906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:32.011141 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:32.011620 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:32.011625 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:32.011627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:32.012226 (+ 599us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:32.012695 (+ 469us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:32.013448 (+ 753us) server_negotiation.cc:299] Negotiation successful
0809 06:52:32.013757 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":859,"thread_start_us":450,"threads_started":1}
I20260809 06:52:32.016019 15928 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:32.166069 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 15802
I20260809 06:52:32.188033 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 15419
I20260809 06:52:32.189253 15483 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:32.303953 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 15419
2026-08-09T06:52:32Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4731 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T06:52:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:32Z Disabled control of system clock
I20260809 06:52:32.379981 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:42315
--webserver_interface=127.10.205.126
--webserver_port=0
--builtin_ntp_servers=127.10.205.84:34927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:42315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 06:52:32.707279 15991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:32.707571 15991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:32.707655 15991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:32.714834 15991 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:32.714946 15991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:32.714993 15991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:32.715049 15991 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:32.715098 15991 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:32.724157 15991 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:42315
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:42315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:32.725411 15991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:32.727202 15991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:32.738802 15996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:32.738863 15997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:32.738860 15999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:32.739908 15991 server_base.cc:1034] running on GCE node
I20260809 06:52:32.740742 15991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:32.742089 15991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:32.743295 15991 hybrid_clock.cc:648] HybridClock initialized: now 1786258352743228 us; error 54 us; skew 500 ppm
I20260809 06:52:32.743659 15991 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:52:32.745893 15991 webserver.cc:460] Webserver started at http://127.10.205.126:43917/ using document root <none> and password file <none>
I20260809 06:52:32.746603 15991 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:32.746718 15991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:32.747052 15991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:32.750051 15991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "25c2526df38f421c97d80dc56d8f3ddc"
format_stamp: "Formatted at 2026-08-09 06:52:32 on dist-test-slave-0b58"
server_key: "9d178f96a972f4a85e972d5754af95dc"
server_key_iv: "dbc7ca6285c3dc49fa8498a349bd8e99"
server_key_version: "encryptionkey@0"
I20260809 06:52:32.750857 15991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "25c2526df38f421c97d80dc56d8f3ddc"
format_stamp: "Formatted at 2026-08-09 06:52:32 on dist-test-slave-0b58"
server_key: "9d178f96a972f4a85e972d5754af95dc"
server_key_iv: "dbc7ca6285c3dc49fa8498a349bd8e99"
server_key_version: "encryptionkey@0"
I20260809 06:52:32.755860 15991 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:52:32.759186 16005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:32.760536 15991 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:32.760712 15991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "25c2526df38f421c97d80dc56d8f3ddc"
format_stamp: "Formatted at 2026-08-09 06:52:32 on dist-test-slave-0b58"
server_key: "9d178f96a972f4a85e972d5754af95dc"
server_key_iv: "dbc7ca6285c3dc49fa8498a349bd8e99"
server_key_version: "encryptionkey@0"
I20260809 06:52:32.760932 15991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:32.766569 15991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:32.767315 15991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:32.767611 15991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:32.786724 15991 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:42315
I20260809 06:52:32.786759 16063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:42315 every 8 connection(s)
I20260809 06:52:32.788200 15991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:32.789842 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 15991
I20260809 06:52:32.790058 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:32.790714 11061 external_mini_cluster.cc:1428] Setting key b73da5bc8358de8274bd077d7e85bff6
I20260809 06:52:32.792176 16064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:32.798693 16067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:32.792694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45074 (local address 127.10.205.126:42315)
0809 06:52:32.793675 (+ 981us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:32.793693 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:32.793733 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:52:32.795236 (+ 1503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:32.795255 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:32.795645 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:32.795977 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:32.797106 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:32.797111 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:32.797123 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:32.797137 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:32.797209 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:32.797227 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:32.797413 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:32.797510 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 06:52:32.797749 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":375,"threads_started":1}
I20260809 06:52:32.804399 16064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc: Bootstrap starting.
I20260809 06:52:32.807267 16064 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:32.808238 16064 log.cc:824] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:32.810860 16064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc: No bootstrap required, opened a new log
I20260809 06:52:32.818192 16064 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c2526df38f421c97d80dc56d8f3ddc" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42315 } }
I20260809 06:52:32.818567 16064 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:32.818670 16064 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c2526df38f421c97d80dc56d8f3ddc, State: Initialized, Role: FOLLOWER
I20260809 06:52:32.819262 16064 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c2526df38f421c97d80dc56d8f3ddc" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42315 } }
I20260809 06:52:32.819510 16064 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:32.819651 16064 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:32.819829 16064 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:32.821966 16064 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c2526df38f421c97d80dc56d8f3ddc" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42315 } }
I20260809 06:52:32.822455 16064 leader_election.cc:302] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25c2526df38f421c97d80dc56d8f3ddc; no voters:
I20260809 06:52:32.823040 16064 leader_election.cc:288] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:32.823189 16069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:32.824502 16069 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [term 1 LEADER]: Becoming Leader. State: Replica: 25c2526df38f421c97d80dc56d8f3ddc, State: Running, Role: LEADER
I20260809 06:52:32.825096 16069 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c2526df38f421c97d80dc56d8f3ddc" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42315 } }
I20260809 06:52:32.825534 16064 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:32.828333 16071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25c2526df38f421c97d80dc56d8f3ddc. Latest consensus state: current_term: 1 leader_uuid: "25c2526df38f421c97d80dc56d8f3ddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c2526df38f421c97d80dc56d8f3ddc" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42315 } } }
I20260809 06:52:32.828893 16071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:32.828428 16070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25c2526df38f421c97d80dc56d8f3ddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c2526df38f421c97d80dc56d8f3ddc" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42315 } } }
I20260809 06:52:32.829380 16070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:32.833103 16078 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:32.837270 16078 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:32.845364 16078 catalog_manager.cc:1347] Generated new cluster ID: ef5da328bf8f41c5bd7670de7dbfac16
I20260809 06:52:32.845471 16078 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:32.860124 16078 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:32.860618 16078 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:32.870628 16078 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc: Generated new TSK 0
I20260809 06:52:32.871500 16078 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:52:32.889241 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:42315
--builtin_ntp_servers=127.10.205.84:34927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 06:52:33.218109 16091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:33.218439 16091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:33.218597 16091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:33.226029 16091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:33.226179 16091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:33.226374 16091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:52:33.235880 16091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:42315
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:33.237238 16091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:33.239007 16091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:33.251868 16099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:33.251819 16097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:33.251842 16096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:33.252621 16091 server_base.cc:1034] running on GCE node
I20260809 06:52:33.253202 16091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:33.254072 16091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:33.255295 16091 hybrid_clock.cc:648] HybridClock initialized: now 1786258353255249 us; error 51 us; skew 500 ppm
I20260809 06:52:33.255604 16091 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:52:33.257831 16091 webserver.cc:460] Webserver started at http://127.10.205.65:37247/ using document root <none> and password file <none>
I20260809 06:52:33.258504 16091 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:33.258634 16091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:33.258955 16091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:33.261838 16091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "3ea4b331abb846afbcdeccd4a9d40e9a"
format_stamp: "Formatted at 2026-08-09 06:52:33 on dist-test-slave-0b58"
server_key: "f90efae1df7f70eacff8227517218dfc"
server_key_iv: "87c964772185e9af974fa596100ef95a"
server_key_version: "encryptionkey@0"
I20260809 06:52:33.262642 16091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "3ea4b331abb846afbcdeccd4a9d40e9a"
format_stamp: "Formatted at 2026-08-09 06:52:33 on dist-test-slave-0b58"
server_key: "f90efae1df7f70eacff8227517218dfc"
server_key_iv: "87c964772185e9af974fa596100ef95a"
server_key_version: "encryptionkey@0"
I20260809 06:52:33.267807 16091 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:52:33.271099 16105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:33.272370 16091 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 06:52:33.272532 16091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "3ea4b331abb846afbcdeccd4a9d40e9a"
format_stamp: "Formatted at 2026-08-09 06:52:33 on dist-test-slave-0b58"
server_key: "f90efae1df7f70eacff8227517218dfc"
server_key_iv: "87c964772185e9af974fa596100ef95a"
server_key_version: "encryptionkey@0"
I20260809 06:52:33.272742 16091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:33.278079 16091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:33.278832 16091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:33.279098 16091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:33.279985 16091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:33.281771 16091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:33.281906 16091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:33.282013 16091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:33.282111 16091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:33.315272 16091 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:41437
I20260809 06:52:33.315335 16224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:41437 every 8 connection(s)
I20260809 06:52:33.316684 16091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:52:33.321962 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 16091
I20260809 06:52:33.322186 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:52:33.322997 11061 external_mini_cluster.cc:1428] Setting key d324d0cbf5555ac0e5d2085f3d0ba7d6
I20260809 06:52:33.325511 16227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:33.319186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:51773 (local address 127.10.205.126:42315)
0809 06:52:33.319620 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:33.319625 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:33.320840 (+ 1215us) server_negotiation.cc:407] Connection header received
0809 06:52:33.323076 (+ 2236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:33.323085 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:33.323153 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:33.323257 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:33.324719 (+ 1462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:33.324724 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:33.324728 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:33.324748 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:33.324814 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:33.324850 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:33.324973 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:33.325182 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 06:52:33.325233 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":222,"threads_started":1}
I20260809 06:52:33.326201 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:42315
--builtin_ntp_servers=127.10.205.84:34927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 06:52:33.326758 16228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:33.319781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:42315 (local address 127.10.205.65:51773)
0809 06:52:33.320681 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:33.320716 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:33.322749 (+ 2033us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:33.323535 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:33.323546 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:33.323671 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:33.324441 (+ 770us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:52:33.324444 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:33.324480 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:52:33.324564 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:33.324961 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:33.324969 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:33.324975 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:52:33.325246 (+ 271us) client_negotiation.cc:240] Negotiation successful
0809 06:52:33.325497 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":252,"threads_started":1}
I20260809 06:52:33.328193 16225 heartbeater.cc:347] Connected to a master server at 127.10.205.126:42315
I20260809 06:52:33.328521 16225 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:33.329231 16225 heartbeater.cc:511] Master 127.10.205.126:42315 requested a full tablet report, sending...
I20260809 06:52:33.331539 16022 ts_manager.cc:194] Registered new tserver with Master: 3ea4b331abb846afbcdeccd4a9d40e9a (127.10.205.65:41437)
W20260809 06:52:33.653424 16229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:33.653718 16229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:33.653810 16229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:33.661518 16229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:33.661629 16229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:33.661921 16229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:52:33.671411 16229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:42315
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:33.672818 16229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:33.674741 16229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:33.688279 16235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:33.688306 16234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:33.688333 16237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:33.689105 16229 server_base.cc:1034] running on GCE node
I20260809 06:52:33.689788 16229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:33.690773 16229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:33.692001 16229 hybrid_clock.cc:648] HybridClock initialized: now 1786258353691965 us; error 52 us; skew 500 ppm
I20260809 06:52:33.692389 16229 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:52:33.694712 16229 webserver.cc:460] Webserver started at http://127.10.205.66:35721/ using document root <none> and password file <none>
I20260809 06:52:33.695436 16229 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:33.695652 16229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:33.696028 16229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:33.698957 16229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "c8262c83b733405d89a0e3ac5bfac662"
format_stamp: "Formatted at 2026-08-09 06:52:33 on dist-test-slave-0b58"
server_key: "13ecfea79759d500ca3ef928acf1dea1"
server_key_iv: "2da7a4363b2dfe0e04e8fd025f4962af"
server_key_version: "encryptionkey@0"
I20260809 06:52:33.699841 16229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "c8262c83b733405d89a0e3ac5bfac662"
format_stamp: "Formatted at 2026-08-09 06:52:33 on dist-test-slave-0b58"
server_key: "13ecfea79759d500ca3ef928acf1dea1"
server_key_iv: "2da7a4363b2dfe0e04e8fd025f4962af"
server_key_version: "encryptionkey@0"
I20260809 06:52:33.704943 16229 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 06:52:33.708555 16244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:33.709860 16229 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:52:33.710062 16229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "c8262c83b733405d89a0e3ac5bfac662"
format_stamp: "Formatted at 2026-08-09 06:52:33 on dist-test-slave-0b58"
server_key: "13ecfea79759d500ca3ef928acf1dea1"
server_key_iv: "2da7a4363b2dfe0e04e8fd025f4962af"
server_key_version: "encryptionkey@0"
I20260809 06:52:33.710309 16229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:33.715991 16229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:33.717267 16229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:33.717587 16229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:33.718552 16229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:33.720093 16229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:33.720288 16229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:33.720433 16229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:33.720535 16229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:33.754906 16229 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:45591
I20260809 06:52:33.754959 16361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:45591 every 8 connection(s)
I20260809 06:52:33.756335 16229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:52:33.761070 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 16229
I20260809 06:52:33.761265 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:52:33.761747 11061 external_mini_cluster.cc:1428] Setting key 39c6d48dbd73ff2ae014d30286dbf48b
I20260809 06:52:33.764851 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:42315
--builtin_ntp_servers=127.10.205.84:34927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 06:52:33.765769 16227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:33.758973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:52663 (local address 127.10.205.126:42315)
0809 06:52:33.759173 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:33.759178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:33.760613 (+ 1435us) server_negotiation.cc:407] Connection header received
0809 06:52:33.762576 (+ 1963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:33.762581 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:33.762682 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:33.762808 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:33.764974 (+ 2166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:33.764981 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:33.764985 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:33.765005 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:33.765049 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:33.765067 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:33.765214 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:33.765405 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 06:52:33.765474 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 06:52:33.766772 16364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:33.759457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:42315 (local address 127.10.205.66:52663)
0809 06:52:33.760447 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:33.760493 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:33.762211 (+ 1718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:33.763731 (+ 1520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:33.763742 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:33.763853 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:33.764668 (+ 815us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:52:33.764671 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:33.764716 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:52:33.764799 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:33.765170 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:33.765181 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:33.765189 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 06:52:33.765536 (+ 347us) client_negotiation.cc:240] Negotiation successful
0809 06:52:33.765805 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":273,"threads_started":1}
I20260809 06:52:33.768136 16362 heartbeater.cc:347] Connected to a master server at 127.10.205.126:42315
I20260809 06:52:33.768476 16362 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:33.769100 16362 heartbeater.cc:511] Master 127.10.205.126:42315 requested a full tablet report, sending...
I20260809 06:52:33.770591 16022 ts_manager.cc:194] Registered new tserver with Master: c8262c83b733405d89a0e3ac5bfac662 (127.10.205.66:45591)
W20260809 06:52:34.094762 16365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:34.095079 16365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:34.095171 16365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:34.102459 16365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:34.102559 16365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:34.102748 16365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:52:34.111855 16365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:42315
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:34.113240 16365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:34.115157 16365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:34.128310 16370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:34.128402 16371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:34.128377 16373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:34.129494 16365 server_base.cc:1034] running on GCE node
I20260809 06:52:34.130115 16365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:34.131093 16365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:34.132360 16365 hybrid_clock.cc:648] HybridClock initialized: now 1786258354132320 us; error 37 us; skew 500 ppm
I20260809 06:52:34.132673 16365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:52:34.134858 16365 webserver.cc:460] Webserver started at http://127.10.205.67:43667/ using document root <none> and password file <none>
I20260809 06:52:34.135632 16365 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:34.135756 16365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:34.136088 16365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:34.139379 16365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "53833927a63d4567bfad6295bc1d7ee1"
format_stamp: "Formatted at 2026-08-09 06:52:34 on dist-test-slave-0b58"
server_key: "b1bca00b0f202aa0ba8ba786d687dbdd"
server_key_iv: "d32d5fb7025ba8fb8745f057ed2cac7b"
server_key_version: "encryptionkey@0"
I20260809 06:52:34.140213 16365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "53833927a63d4567bfad6295bc1d7ee1"
format_stamp: "Formatted at 2026-08-09 06:52:34 on dist-test-slave-0b58"
server_key: "b1bca00b0f202aa0ba8ba786d687dbdd"
server_key_iv: "d32d5fb7025ba8fb8745f057ed2cac7b"
server_key_version: "encryptionkey@0"
I20260809 06:52:34.145538 16365 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260809 06:52:34.149178 16380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:34.150460 16365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:52:34.150632 16365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "53833927a63d4567bfad6295bc1d7ee1"
format_stamp: "Formatted at 2026-08-09 06:52:34 on dist-test-slave-0b58"
server_key: "b1bca00b0f202aa0ba8ba786d687dbdd"
server_key_iv: "d32d5fb7025ba8fb8745f057ed2cac7b"
server_key_version: "encryptionkey@0"
I20260809 06:52:34.150878 16365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:34.156569 16365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:34.157371 16365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:34.157652 16365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:34.158633 16365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:34.160250 16365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:34.160409 16365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:34.160542 16365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:34.160642 16365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:34.193521 16365 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:41967
I20260809 06:52:34.193578 16496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:41967 every 8 connection(s)
I20260809 06:52:34.194864 16365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:52:34.200188 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 16365
I20260809 06:52:34.200446 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:52:34.200881 11061 external_mini_cluster.cc:1428] Setting key 9b968a21250a008a90a18dacfcadf1f7
I20260809 06:52:34.203234 16227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.197422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:37151 (local address 127.10.205.126:42315)
0809 06:52:34.197638 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:34.197643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:34.198979 (+ 1336us) server_negotiation.cc:407] Connection header received
0809 06:52:34.200750 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:34.200755 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:34.200828 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:34.200931 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:34.202441 (+ 1510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:34.202445 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:34.202448 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:34.202464 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:34.202499 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:34.202510 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:34.202608 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:34.202798 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 06:52:34.202869 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260809 06:52:34.204365 16499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.197902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:42315 (local address 127.10.205.67:37151)
0809 06:52:34.198809 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.198851 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:34.200467 (+ 1616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:34.201149 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:34.201156 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:34.201238 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:34.202106 (+ 868us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:52:34.202110 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:34.202164 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:52:34.202281 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:34.202597 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:34.202605 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:34.202610 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 06:52:34.202886 (+ 276us) client_negotiation.cc:240] Negotiation successful
0809 06:52:34.203135 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":279,"threads_started":1}
I20260809 06:52:34.205686 16497 heartbeater.cc:347] Connected to a master server at 127.10.205.126:42315
I20260809 06:52:34.205956 16497 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:34.206547 16497 heartbeater.cc:511] Master 127.10.205.126:42315 requested a full tablet report, sending...
I20260809 06:52:34.207864 16022 ts_manager.cc:194] Registered new tserver with Master: 53833927a63d4567bfad6295bc1d7ee1 (127.10.205.67:41967)
I20260809 06:52:34.217025 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:52:34.224192 16227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.221482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45090 (local address 127.10.205.126:42315)
0809 06:52:34.221646 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:34.221651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:34.222148 (+ 497us) server_negotiation.cc:407] Connection header received
0809 06:52:34.222348 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:34.222352 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:34.222413 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:34.222505 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:34.223482 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:34.223488 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:34.223493 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:34.223511 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:34.223549 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:34.223560 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:34.223681 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:34.223804 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 06:52:34.223870 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:52:34.228995 16022 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:52:34.237231 16022 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:34.255972 16511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.249454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:45591 (local address 127.0.0.1:34436)
0809 06:52:34.250137 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.250160 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:34.250289 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:34.253293 (+ 3004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:34.253304 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:34.253446 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:34.254526 (+ 1080us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:52:34.254532 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:34.254582 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:52:34.254683 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:34.255152 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:34.255171 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:34.255181 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 06:52:34.255360 (+ 179us) client_negotiation.cc:240] Negotiation successful
0809 06:52:34.255453 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":637,"threads_started":1}
I20260809 06:52:34.256916 16513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.249898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34436 (local address 127.10.205.66:45591)
0809 06:52:34.252692 (+ 2794us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:34.252700 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:34.252732 (+ 32us) server_negotiation.cc:407] Connection header received
0809 06:52:34.252809 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:34.252815 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:34.253063 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:34.253224 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:34.254869 (+ 1645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:34.254878 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:34.254892 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:34.254920 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:34.254989 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:34.255012 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:34.256300 (+ 1288us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:34.256403 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 06:52:34.256509 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2640,"thread_start_us":2503,"threads_started":1}
I20260809 06:52:34.257575 16516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.251223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43984 (local address 127.10.205.67:41967)
0809 06:52:34.252036 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:34.252048 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:34.252912 (+ 864us) server_negotiation.cc:407] Connection header received
0809 06:52:34.253053 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:34.253061 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:34.253251 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:34.253416 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:34.255894 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:34.255903 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:34.255914 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:34.255936 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:34.256000 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:34.256023 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:34.256474 (+ 451us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:34.256759 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 06:52:34.256889 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":437,"threads_started":1}
I20260809 06:52:34.258078 16514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.250777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:41967 (local address 127.0.0.1:43984)
0809 06:52:34.252756 (+ 1979us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.252780 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:34.252923 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:34.254429 (+ 1506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:34.254435 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:34.254458 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:34.255647 (+ 1189us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:52:34.255651 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:34.255667 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:52:34.255714 (+ 47us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:34.256581 (+ 867us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:34.256586 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:34.256590 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 06:52:34.256726 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 06:52:34.256776 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1822,"thread_start_us":1817,"threads_started":1}
I20260809 06:52:34.260849 16292 tablet_service.cc:1467] Processing CreateTablet for tablet 1909fc05b63f4892b910eb71d29266df (DEFAULT_TABLE table=test-table [id=7566657dd1d84378b3557621ccc0b916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:34.262428 16292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1909fc05b63f4892b910eb71d29266df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:34.262188 16430 tablet_service.cc:1467] Processing CreateTablet for tablet 1909fc05b63f4892b910eb71d29266df (DEFAULT_TABLE table=test-table [id=7566657dd1d84378b3557621ccc0b916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:34.263353 16430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1909fc05b63f4892b910eb71d29266df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:34.270079 16509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.248903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:41437 (local address 127.0.0.1:55914)
0809 06:52:34.249727 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.249771 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:34.249945 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:34.261254 (+ 11309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:34.261259 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:34.261297 (+ 38us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:34.268834 (+ 7537us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:52:34.268839 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:34.268857 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:52:34.268909 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:34.269419 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:34.269424 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:34.269430 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:52:34.269548 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 06:52:34.269609 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":1588,"threads_started":1}
I20260809 06:52:34.270939 16510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.249239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55914 (local address 127.10.205.65:41437)
0809 06:52:34.260703 (+ 11464us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:34.260711 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:34.260740 (+ 29us) server_negotiation.cc:407] Connection header received
0809 06:52:34.260818 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:34.260828 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:34.261054 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:34.261218 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:34.269131 (+ 7913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:34.269141 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:34.269155 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:34.269186 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:34.269265 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:34.269285 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:34.270368 (+ 1083us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:34.270453 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 06:52:34.270584 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11307,"thread_start_us":11192,"threads_started":1}
I20260809 06:52:34.274603 16517 tablet_bootstrap.cc:492] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662: Bootstrap starting.
I20260809 06:52:34.274811 16155 tablet_service.cc:1467] Processing CreateTablet for tablet 1909fc05b63f4892b910eb71d29266df (DEFAULT_TABLE table=test-table [id=7566657dd1d84378b3557621ccc0b916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:34.275921 16155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1909fc05b63f4892b910eb71d29266df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:34.279220 16517 tablet_bootstrap.cc:654] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:34.280706 16517 log.cc:824] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:34.281375 16518 tablet_bootstrap.cc:492] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1: Bootstrap starting.
I20260809 06:52:34.284126 16517 tablet_bootstrap.cc:492] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662: No bootstrap required, opened a new log
I20260809 06:52:34.284482 16517 ts_tablet_manager.cc:1397] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.007s
I20260809 06:52:34.285266 16518 tablet_bootstrap.cc:654] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:34.286499 16518 log.cc:824] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:34.289700 16518 tablet_bootstrap.cc:492] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1: No bootstrap required, opened a new log
I20260809 06:52:34.289966 16521 tablet_bootstrap.cc:492] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a: Bootstrap starting.
I20260809 06:52:34.290021 16518 ts_tablet_manager.cc:1397] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 06:52:34.292980 16521 tablet_bootstrap.cc:654] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:34.294279 16521 log.cc:824] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:34.294831 16517 raft_consensus.cc:348] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 41437 } } peers { permanent_uuid: "53833927a63d4567bfad6295bc1d7ee1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41967 } } peers { permanent_uuid: "c8262c83b733405d89a0e3ac5bfac662" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45591 } }
I20260809 06:52:34.295301 16517 raft_consensus.cc:374] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:34.295461 16517 raft_consensus.cc:729] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8262c83b733405d89a0e3ac5bfac662, State: Initialized, Role: FOLLOWER
I20260809 06:52:34.296111 16517 consensus_queue.cc:260] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 41437 } } peers { permanent_uuid: "53833927a63d4567bfad6295bc1d7ee1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41967 } } peers { permanent_uuid: "c8262c83b733405d89a0e3ac5bfac662" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45591 } }
I20260809 06:52:34.297325 16362 heartbeater.cc:503] Master 127.10.205.126:42315 was elected leader, sending a full tablet report...
I20260809 06:52:34.297909 16517 ts_tablet_manager.cc:1428] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662: Time spent starting tablet: real 0.013s user 0.005s sys 0.008s
I20260809 06:52:34.298112 16521 tablet_bootstrap.cc:492] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a: No bootstrap required, opened a new log
I20260809 06:52:34.298451 16521 ts_tablet_manager.cc:1397] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 06:52:34.300554 16518 raft_consensus.cc:348] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 41437 } } peers { permanent_uuid: "53833927a63d4567bfad6295bc1d7ee1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41967 } } peers { permanent_uuid: "c8262c83b733405d89a0e3ac5bfac662" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45591 } }
I20260809 06:52:34.300990 16518 raft_consensus.cc:374] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:34.301107 16518 raft_consensus.cc:729] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53833927a63d4567bfad6295bc1d7ee1, State: Initialized, Role: FOLLOWER
I20260809 06:52:34.301716 16518 consensus_queue.cc:260] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 41437 } } peers { permanent_uuid: "53833927a63d4567bfad6295bc1d7ee1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41967 } } peers { permanent_uuid: "c8262c83b733405d89a0e3ac5bfac662" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45591 } }
I20260809 06:52:34.303052 16497 heartbeater.cc:503] Master 127.10.205.126:42315 was elected leader, sending a full tablet report...
I20260809 06:52:34.303546 16518 ts_tablet_manager.cc:1428] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260809 06:52:34.308079 16521 raft_consensus.cc:348] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 41437 } } peers { permanent_uuid: "53833927a63d4567bfad6295bc1d7ee1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41967 } } peers { permanent_uuid: "c8262c83b733405d89a0e3ac5bfac662" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45591 } }
I20260809 06:52:34.308467 16521 raft_consensus.cc:374] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:34.308581 16521 raft_consensus.cc:729] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea4b331abb846afbcdeccd4a9d40e9a, State: Initialized, Role: FOLLOWER
I20260809 06:52:34.309036 16521 consensus_queue.cc:260] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 41437 } } peers { permanent_uuid: "53833927a63d4567bfad6295bc1d7ee1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41967 } } peers { permanent_uuid: "c8262c83b733405d89a0e3ac5bfac662" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45591 } }
I20260809 06:52:34.309908 16225 heartbeater.cc:503] Master 127.10.205.126:42315 was elected leader, sending a full tablet report...
I20260809 06:52:34.310467 16521 ts_tablet_manager.cc:1428] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
W20260809 06:52:34.318755 16226 tablet.cc:2369] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:52:34.322952 16525 raft_consensus.cc:482] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:34.323212 16525 raft_consensus.cc:504] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 41437 } } peers { permanent_uuid: "53833927a63d4567bfad6295bc1d7ee1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41967 } } peers { permanent_uuid: "c8262c83b733405d89a0e3ac5bfac662" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45591 } }
I20260809 06:52:34.324847 16525 leader_election.cc:288] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53833927a63d4567bfad6295bc1d7ee1 (127.10.205.67:41967), c8262c83b733405d89a0e3ac5bfac662 (127.10.205.66:45591)
I20260809 06:52:34.328487 16516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.325273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:44729 (local address 127.10.205.67:41967)
0809 06:52:34.325450 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:34.325456 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:34.326281 (+ 825us) server_negotiation.cc:407] Connection header received
0809 06:52:34.326458 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:34.326464 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:34.326524 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:34.326620 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:34.327848 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:34.327854 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:34.327859 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:34.327878 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:34.327916 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:34.327932 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:34.328060 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:34.328147 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 06:52:34.328206 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:52:34.328487 16513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.325310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:53245 (local address 127.10.205.66:45591)
0809 06:52:34.325476 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:34.325483 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:34.326258 (+ 775us) server_negotiation.cc:407] Connection header received
0809 06:52:34.326413 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:34.326420 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:34.326481 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:34.326588 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:34.327848 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:34.327854 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:34.327859 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:34.327878 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:34.327916 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:34.327932 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:34.328061 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:34.328147 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 06:52:34.328206 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:52:34.328776 16526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.325131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:45591 (local address 127.10.205.65:53245)
0809 06:52:34.326124 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.326144 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:34.326275 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:34.326652 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:34.326657 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:34.326683 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:34.327615 (+ 932us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:52:34.327619 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:34.327638 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:52:34.327686 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:34.328038 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:34.328043 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:34.328049 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:52:34.328200 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 06:52:34.328295 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":820,"thread_start_us":575,"threads_started":1}
I20260809 06:52:34.328903 16527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.325224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:41967 (local address 127.10.205.65:44729)
0809 06:52:34.326178 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.326195 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:34.326337 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:34.326652 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:34.326657 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:34.326683 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:34.327636 (+ 953us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:52:34.327639 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:34.327650 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:52:34.327686 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:34.328038 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:34.328043 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:34.328049 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:52:34.328227 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 06:52:34.328314 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":810,"mutex_wait_us":44,"spinlock_wait_cycles":17792,"thread_start_us":487,"threads_started":1}
I20260809 06:52:34.330015 16313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1909fc05b63f4892b910eb71d29266df" candidate_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8262c83b733405d89a0e3ac5bfac662" is_pre_election: true
I20260809 06:52:34.330029 16452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1909fc05b63f4892b910eb71d29266df" candidate_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53833927a63d4567bfad6295bc1d7ee1" is_pre_election: true
I20260809 06:52:34.330610 16313 raft_consensus.cc:2454] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea4b331abb846afbcdeccd4a9d40e9a in term 0.
I20260809 06:52:34.330610 16452 raft_consensus.cc:2454] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea4b331abb846afbcdeccd4a9d40e9a in term 0.
I20260809 06:52:34.331315 16106 leader_election.cc:302] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3ea4b331abb846afbcdeccd4a9d40e9a, 53833927a63d4567bfad6295bc1d7ee1, c8262c83b733405d89a0e3ac5bfac662; no voters:
I20260809 06:52:34.331715 16525 raft_consensus.cc:2781] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:34.331862 16525 raft_consensus.cc:482] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:34.331966 16525 raft_consensus.cc:3037] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:34.334569 16525 raft_consensus.cc:504] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 41437 } } peers { permanent_uuid: "53833927a63d4567bfad6295bc1d7ee1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41967 } } peers { permanent_uuid: "c8262c83b733405d89a0e3ac5bfac662" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45591 } }
I20260809 06:52:34.335191 16525 leader_election.cc:288] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [CANDIDATE]: Term 1 election: Requested vote from peers 53833927a63d4567bfad6295bc1d7ee1 (127.10.205.67:41967), c8262c83b733405d89a0e3ac5bfac662 (127.10.205.66:45591)
I20260809 06:52:34.335595 16452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1909fc05b63f4892b910eb71d29266df" candidate_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53833927a63d4567bfad6295bc1d7ee1"
I20260809 06:52:34.335667 16313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1909fc05b63f4892b910eb71d29266df" candidate_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8262c83b733405d89a0e3ac5bfac662"
I20260809 06:52:34.335896 16452 raft_consensus.cc:3037] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:34.335887 16313 raft_consensus.cc:3037] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:34.338248 16313 raft_consensus.cc:2454] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea4b331abb846afbcdeccd4a9d40e9a in term 1.
I20260809 06:52:34.338598 16452 raft_consensus.cc:2454] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea4b331abb846afbcdeccd4a9d40e9a in term 1.
I20260809 06:52:34.338694 16106 leader_election.cc:302] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea4b331abb846afbcdeccd4a9d40e9a, c8262c83b733405d89a0e3ac5bfac662; no voters:
I20260809 06:52:34.339005 16525 raft_consensus.cc:2781] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:34.339380 16525 raft_consensus.cc:686] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [term 1 LEADER]: Becoming Leader. State: Replica: 3ea4b331abb846afbcdeccd4a9d40e9a, State: Running, Role: LEADER
I20260809 06:52:34.339857 16525 consensus_queue.cc:237] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 41437 } } peers { permanent_uuid: "53833927a63d4567bfad6295bc1d7ee1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41967 } } peers { permanent_uuid: "c8262c83b733405d89a0e3ac5bfac662" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45591 } }
I20260809 06:52:34.344128 16021 catalog_manager.cc:5495] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ea4b331abb846afbcdeccd4a9d40e9a (127.10.205.65). New cstate: current_term: 1 leader_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea4b331abb846afbcdeccd4a9d40e9a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 41437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53833927a63d4567bfad6295bc1d7ee1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8262c83b733405d89a0e3ac5bfac662" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45591 } health_report { overall_health: UNKNOWN } } }
I20260809 06:52:34.361171 16510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.359145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55928 (local address 127.10.205.65:41437)
0809 06:52:34.359323 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:34.359328 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:34.359483 (+ 155us) server_negotiation.cc:407] Connection header received
0809 06:52:34.359647 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:34.359651 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:34.359726 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:34.359818 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:34.360715 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:34.360719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:34.360722 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:34.360734 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:34.360761 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:34.360773 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:34.360862 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:34.360901 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 06:52:34.360944 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:52:34.369074 16452 raft_consensus.cc:1261] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1 [term 1 FOLLOWER]: Refusing update from remote peer 3ea4b331abb846afbcdeccd4a9d40e9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:34.369077 16313 raft_consensus.cc:1261] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662 [term 1 FOLLOWER]: Refusing update from remote peer 3ea4b331abb846afbcdeccd4a9d40e9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:34.370031 16528 consensus_queue.cc:1035] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "53833927a63d4567bfad6295bc1d7ee1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:34.370376 16525 consensus_queue.cc:1035] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8262c83b733405d89a0e3ac5bfac662" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:34.382401 16531 mvcc.cc:205] Tried to move back new op lower bound from 7316514219486425088 to 7316514219380019200. Current Snapshot: MvccSnapshot[applied={T|T < 7316514219486425088}]
I20260809 06:52:34.398236 16020 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:34.398561 16020 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:34.402076 16020 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 25c2526df38f421c97d80dc56d8f3ddc: Sending DeleteTablet for 3 replicas of tablet 1909fc05b63f4892b910eb71d29266df
I20260809 06:52:34.403126 16155 tablet_service.cc:1514] Processing DeleteTablet for tablet 1909fc05b63f4892b910eb71d29266df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:34 UTC) from {username='slave'} at 127.0.0.1:55914
I20260809 06:52:34.403326 16430 tablet_service.cc:1514] Processing DeleteTablet for tablet 1909fc05b63f4892b910eb71d29266df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:34 UTC) from {username='slave'} at 127.0.0.1:43984
I20260809 06:52:34.404348 16292 tablet_service.cc:1514] Processing DeleteTablet for tablet 1909fc05b63f4892b910eb71d29266df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:34 UTC) from {username='slave'} at 127.0.0.1:34436
I20260809 06:52:34.404960 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 16091
I20260809 06:52:34.412186 16544 tablet_replica.cc:330] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662: stopping tablet replica
I20260809 06:52:34.412865 16544 raft_consensus.cc:2229] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:34.413615 16544 raft_consensus.cc:2258] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:34.416420 16510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.407416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55930 (local address 127.10.205.65:41437)
0809 06:52:34.407635 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:34.407643 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:34.411792 (+ 4149us) server_negotiation.cc:407] Connection header received
0809 06:52:34.412740 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:34.412747 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:34.412810 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:34.412889 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:34.415427 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:34.415433 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:34.415438 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:34.415457 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:34.415496 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:34.415512 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:34.415603 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:34.416009 (+ 406us) server_negotiation.cc:299] Negotiation successful
0809 06:52:34.416074 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:52:34.416479 16544 ts_tablet_manager.cc:1905] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:34.417789 16220 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:34.418763 16543 tablet_replica.cc:330] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1: stopping tablet replica
I20260809 06:52:34.419436 16543 raft_consensus.cc:2229] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:34.420001 16543 raft_consensus.cc:2258] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:34.423475 16543 ts_tablet_manager.cc:1905] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:34.424201 16544 ts_tablet_manager.cc:1918] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:34.424543 16544 log.cc:1196] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/1909fc05b63f4892b910eb71d29266df
I20260809 06:52:34.425312 16544 ts_tablet_manager.cc:1939] T 1909fc05b63f4892b910eb71d29266df P c8262c83b733405d89a0e3ac5bfac662: Deleting consensus metadata
I20260809 06:52:34.427366 16006 catalog_manager.cc:4841] TS c8262c83b733405d89a0e3ac5bfac662 (127.10.205.66:45591): tablet 1909fc05b63f4892b910eb71d29266df (table test-table [id=7566657dd1d84378b3557621ccc0b916]) successfully deleted
I20260809 06:52:34.430826 16543 ts_tablet_manager.cc:1918] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:34.431010 16543 log.cc:1196] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/1909fc05b63f4892b910eb71d29266df
I20260809 06:52:34.431530 16543 ts_tablet_manager.cc:1939] T 1909fc05b63f4892b910eb71d29266df P 53833927a63d4567bfad6295bc1d7ee1: Deleting consensus metadata
I20260809 06:52:34.433132 16007 catalog_manager.cc:4841] TS 53833927a63d4567bfad6295bc1d7ee1 (127.10.205.67:41967): tablet 1909fc05b63f4892b910eb71d29266df (table test-table [id=7566657dd1d84378b3557621ccc0b916]) successfully deleted
I20260809 06:52:34.519328 16542 tablet_replica.cc:330] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a: stopping tablet replica
I20260809 06:52:34.519917 16542 raft_consensus.cc:2229] T 1909fc05b63f4892b910eb71d29266df P 3ea4b331abb846afbcdeccd4a9d40e9a [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:34.520347 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 16091
I20260809 06:52:34.540575 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 16229
W20260809 06:52:34.540495 16007 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.205.65:41437 (error 108)
I20260809 06:52:34.542469 16509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.541941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:41437 (local address 127.0.0.1:55932)
0809 06:52:34.542161 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.542273 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:41437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260809 06:52:34.542749 16007 catalog_manager.cc:4584] TS 3ea4b331abb846afbcdeccd4a9d40e9a (127.10.205.65:41437): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1909fc05b63f4892b910eb71d29266df: Network error: Client connection negotiation failed: client connection to 127.10.205.65:41437: connect: Connection refused (error 111)
I20260809 06:52:34.543623 16513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.541485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34440 (local address 127.10.205.66:45591)
0809 06:52:34.541695 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:34.541702 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:34.541724 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:52:34.541801 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:34.541808 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:34.541899 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:34.541985 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:34.543048 (+ 1063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:34.543054 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:34.543058 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:34.543076 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:34.543120 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:34.543141 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:34.543242 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:34.543356 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 06:52:34.543403 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 06:52:34.544355 16357 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:34.596638 16509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.595989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:41437 (local address 127.0.0.1:55942)
0809 06:52:34.596253 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.596417 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:41437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260809 06:52:34.597766 16509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.597369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:41437 (local address 127.0.0.1:55950)
0809 06:52:34.597540 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.597627 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:41437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 06:52:34.633061 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 16229
I20260809 06:52:34.652987 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 16365
I20260809 06:52:34.656047 16516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.653793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43986 (local address 127.10.205.67:41967)
0809 06:52:34.653986 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:34.653994 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:34.654017 (+ 23us) server_negotiation.cc:407] Connection header received
0809 06:52:34.654226 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:34.654232 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:34.654354 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:34.654471 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:34.655355 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:34.655360 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:34.655364 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:34.655384 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:34.655426 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:34.655440 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:34.655595 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:34.655687 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 06:52:34.655750 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:52:34.656747 16492 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:34.658529 16509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.657953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:41437 (local address 127.0.0.1:55954)
0809 06:52:34.658196 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.658333 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:41437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 06:52:34.659745 16509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.659331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:41437 (local address 127.0.0.1:55970)
0809 06:52:34.659485 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.659588 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:41437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 06:52:34.740415 16509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.739889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:41437 (local address 127.0.0.1:55980)
0809 06:52:34.740085 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.740193 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:41437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 06:52:34.741433 16509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:34.741049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:41437 (local address 127.0.0.1:55986)
0809 06:52:34.741253 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:34.741320 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:41437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260809 06:52:34.747623 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 16365
I20260809 06:52:34.767563 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 15991
I20260809 06:52:34.768767 16058 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:34.877040 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 15991
2026-08-09T06:52:34Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2570 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 06:52:34.919410 11061 mini_oidc.cc:152] Starting JWKS server
I20260809 06:52:34.922345 11061 webserver.cc:460] Webserver started at https://127.0.0.1:46001/ using document root <none> and password file <none>
I20260809 06:52:34.922665 11061 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 06:52:34.923342 11061 webserver.cc:460] Webserver started at http://127.0.0.1:37997/ using document root <none> and password file <none>
2026-08-09T06:52:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:34Z Disabled control of system clock
I20260809 06:52:34.958341 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:45827
--webserver_interface=127.10.205.126
--webserver_port=0
--builtin_ntp_servers=127.10.205.84:46221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:45827
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46001/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/testchainca.cert with env {}
W20260809 06:52:35.285980 16556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:35.286386 16556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:35.286546 16556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:35.293977 16556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:35.294124 16556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:35.294219 16556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:35.294327 16556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:35.294401 16556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 06:52:35.294492 16556 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 06:52:35.294562 16556 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46001/jwks.json
I20260809 06:52:35.304714 16556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:45827
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:45827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46001/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:35.306063 16556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:35.307466 16556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:35.319408 16561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:35.319365 16562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:35.319434 16564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:35.321627 16556 server_base.cc:1034] running on GCE node
I20260809 06:52:35.322335 16556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:35.323669 16556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:35.324887 16556 hybrid_clock.cc:648] HybridClock initialized: now 1786258355324837 us; error 59 us; skew 500 ppm
I20260809 06:52:35.325250 16556 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:52:35.327459 16556 webserver.cc:460] Webserver started at http://127.10.205.126:42659/ using document root <none> and password file <none>
I20260809 06:52:35.328138 16556 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:35.328310 16556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:35.328634 16556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:35.331606 16556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "bf866f4e37554b04815ba06900f68225"
format_stamp: "Formatted at 2026-08-09 06:52:35 on dist-test-slave-0b58"
server_key: "36f426bd0a694b02fe63937929b0d52e"
server_key_iv: "9d5cf1838d5a13016249dde6a48b637f"
server_key_version: "encryptionkey@0"
I20260809 06:52:35.332475 16556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "bf866f4e37554b04815ba06900f68225"
format_stamp: "Formatted at 2026-08-09 06:52:35 on dist-test-slave-0b58"
server_key: "36f426bd0a694b02fe63937929b0d52e"
server_key_iv: "9d5cf1838d5a13016249dde6a48b637f"
server_key_version: "encryptionkey@0"
I20260809 06:52:35.337759 16556 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260809 06:52:35.341081 16570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:35.342267 16556 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:52:35.342439 16556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "bf866f4e37554b04815ba06900f68225"
format_stamp: "Formatted at 2026-08-09 06:52:35 on dist-test-slave-0b58"
server_key: "36f426bd0a694b02fe63937929b0d52e"
server_key_iv: "9d5cf1838d5a13016249dde6a48b637f"
server_key_version: "encryptionkey@0"
I20260809 06:52:35.342641 16556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:35.375339 16556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:35.376225 16556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:35.376593 16556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:35.395144 16556 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:45827
I20260809 06:52:35.395164 16624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:45827 every 8 connection(s)
I20260809 06:52:35.396472 16556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:35.400206 16625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:35.401351 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 16556
I20260809 06:52:35.401556 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:35.402256 11061 external_mini_cluster.cc:1428] Setting key 1cde0c9720436128d449b953039aff04
I20260809 06:52:35.414208 16625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225: Bootstrap starting.
I20260809 06:52:35.415987 16628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:35.404106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52820 (local address 127.10.205.126:45827)
0809 06:52:35.405212 (+ 1106us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:35.405223 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:35.405271 (+ 48us) server_negotiation.cc:407] Connection header received
0809 06:52:35.406954 (+ 1683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:35.406979 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:35.407434 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:35.407778 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:35.408434 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:35.409669 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:35.411568 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:35.412225 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:35.412415 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:35.413728 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:35.413736 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:35.413748 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:35.414266 (+ 518us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:35.414366 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:35.414396 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:35.414490 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:35.414745 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 06:52:35.415063 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":722,"thread_start_us":465,"threads_started":1}
I20260809 06:52:35.417636 16625 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:35.418865 16625 log.cc:824] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:35.419725 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:52:35.421675 16625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225: No bootstrap required, opened a new log
I20260809 06:52:35.429440 16625 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf866f4e37554b04815ba06900f68225" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45827 } }
I20260809 06:52:35.429867 16625 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:35.429958 16625 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf866f4e37554b04815ba06900f68225, State: Initialized, Role: FOLLOWER
I20260809 06:52:35.430490 16625 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf866f4e37554b04815ba06900f68225" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45827 } }
I20260809 06:52:35.430783 16625 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:35.430912 16625 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:35.431072 16625 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:35.433314 16625 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf866f4e37554b04815ba06900f68225" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45827 } }
I20260809 06:52:35.433845 16625 leader_election.cc:302] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf866f4e37554b04815ba06900f68225; no voters:
I20260809 06:52:35.434538 16625 leader_election.cc:288] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:35.434721 16630 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:35.435437 16630 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [term 1 LEADER]: Becoming Leader. State: Replica: bf866f4e37554b04815ba06900f68225, State: Running, Role: LEADER
I20260809 06:52:35.435963 16630 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf866f4e37554b04815ba06900f68225" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45827 } }
I20260809 06:52:35.436630 16625 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:35.439299 16631 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf866f4e37554b04815ba06900f68225" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf866f4e37554b04815ba06900f68225" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45827 } } }
I20260809 06:52:35.440267 16631 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:35.439512 16632 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf866f4e37554b04815ba06900f68225. Latest consensus state: current_term: 1 leader_uuid: "bf866f4e37554b04815ba06900f68225" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf866f4e37554b04815ba06900f68225" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45827 } } }
I20260809 06:52:35.440693 16632 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:35.449175 16638 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:35.453991 16638 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:35.462036 16638 catalog_manager.cc:1347] Generated new cluster ID: 39cc14ca340547c7a44d00135a2990e4
I20260809 06:52:35.462153 16638 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:35.518824 16638 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:35.520102 16638 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:35.528381 16638 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf866f4e37554b04815ba06900f68225: Generated new TSK 0
I20260809 06:52:35.529152 16638 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 06:52:35.579684 16655 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 06:52:35.579897 16655 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 06:52:35.581226 16628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:35.559246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52834 (local address 127.10.205.126:45827)
0809 06:52:35.559462 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:35.559469 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:35.559984 (+ 515us) server_negotiation.cc:407] Connection header received
0809 06:52:35.560319 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:35.560330 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:35.560445 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:35.560598 (+ 153us) server_negotiation.cc:226] Negotiated authn=JWT
0809 06:52:35.561134 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:35.562280 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:35.563714 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:35.564447 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:35.564601 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:35.565094 (+ 493us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 06:52:35.580510 (+ 15416us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46001/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 06:52:35.580917 (+ 407us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52834: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46001/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 06:52:35.581367 16628 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52834: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46001/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 06:52:35.582736 16654 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:52:35.559129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45827 (local address 127.0.0.1:52834)
0809 06:52:35.559882 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:35.559898 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:35.560043 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:35.560626 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:35.560630 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:35.560640 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0809 06:52:35.560988 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:35.560996 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:35.562428 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:35.562431 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:35.563551 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:35.563561 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:35.564613 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:35.564617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:35.564754 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:35.564813 (+ 59us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 06:52:35.580842 (+ 16029us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46001/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 06:52:35.581105 (+ 263us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.205.126:45827: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46001/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":367,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.10.205.126:45827: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46001/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 06:52:35.584656 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 16556
I20260809 06:52:35.585773 16619 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:35.684387 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 16556
2026-08-09T06:52:35Z chronyd exiting
I20260809 06:52:35.740087 11061 test_util.cc:175] -----------------------------------------------
I20260809 06:52:35.740212 11061 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786258311159624-11061-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (825 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 06:52:35.743958 11061 mini_oidc.cc:152] Starting JWKS server
I20260809 06:52:35.745664 11061 webserver.cc:460] Webserver started at https://127.0.0.1:43437/ using document root <none> and password file <none>
I20260809 06:52:35.745913 11061 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 06:52:35.746556 11061 webserver.cc:460] Webserver started at http://127.0.0.1:40947/ using document root <none> and password file <none>
2026-08-09T06:52:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:35Z Disabled control of system clock
I20260809 06:52:35.779826 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:35063
--webserver_interface=127.10.205.126
--webserver_port=0
--builtin_ntp_servers=127.10.205.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:35063
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43437/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/testchainca.cert with env {}
W20260809 06:52:36.102334 16662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:36.102674 16662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:36.102842 16662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:36.110028 16662 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:36.110179 16662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:36.110278 16662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:36.110510 16662 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:36.110620 16662 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 06:52:36.110725 16662 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 06:52:36.110807 16662 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43437/jwks.json
I20260809 06:52:36.120939 16662 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:35063
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:35063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43437/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:36.122284 16662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:36.123544 16662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:36.135290 16668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:36.135210 16669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:36.135263 16671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:36.136225 16662 server_base.cc:1034] running on GCE node
I20260809 06:52:36.137024 16662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:36.138315 16662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:36.139544 16662 hybrid_clock.cc:648] HybridClock initialized: now 1786258356139502 us; error 54 us; skew 500 ppm
I20260809 06:52:36.139914 16662 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:52:36.142118 16662 webserver.cc:460] Webserver started at http://127.10.205.126:44253/ using document root <none> and password file <none>
I20260809 06:52:36.142860 16662 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:36.142997 16662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:36.143323 16662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:36.146256 16662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "d2e76d29b6ce404aad65a037b0e24901"
format_stamp: "Formatted at 2026-08-09 06:52:36 on dist-test-slave-0b58"
server_key: "23bb759266919d97630769782e498a28"
server_key_iv: "016d328c3e439b9e22acba0a40a13ca4"
server_key_version: "encryptionkey@0"
I20260809 06:52:36.147121 16662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "d2e76d29b6ce404aad65a037b0e24901"
format_stamp: "Formatted at 2026-08-09 06:52:36 on dist-test-slave-0b58"
server_key: "23bb759266919d97630769782e498a28"
server_key_iv: "016d328c3e439b9e22acba0a40a13ca4"
server_key_version: "encryptionkey@0"
I20260809 06:52:36.152017 16662 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 06:52:36.155416 16677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:36.156774 16662 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:36.156971 16662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "d2e76d29b6ce404aad65a037b0e24901"
format_stamp: "Formatted at 2026-08-09 06:52:36 on dist-test-slave-0b58"
server_key: "23bb759266919d97630769782e498a28"
server_key_iv: "016d328c3e439b9e22acba0a40a13ca4"
server_key_version: "encryptionkey@0"
I20260809 06:52:36.157189 16662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:36.173679 16662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:36.174557 16662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:36.174885 16662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:36.194248 16662 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:35063
I20260809 06:52:36.194276 16732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:35063 every 8 connection(s)
I20260809 06:52:36.195660 16662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:36.199292 16733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:36.201388 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 16662
I20260809 06:52:36.201619 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:36.202265 11061 external_mini_cluster.cc:1428] Setting key 09915fb84cbbb7bd492d43520463a002
I20260809 06:52:36.212779 16733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901: Bootstrap starting.
I20260809 06:52:36.216477 16733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:36.217842 16736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:36.204152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43390 (local address 127.10.205.126:35063)
0809 06:52:36.205309 (+ 1157us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:36.205323 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:36.205377 (+ 54us) server_negotiation.cc:407] Connection header received
0809 06:52:36.207738 (+ 2361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:36.207767 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:36.208356 (+ 589us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:36.208797 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:36.209323 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:36.211353 (+ 2030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:36.212756 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:36.213735 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:36.213928 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:36.215046 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:36.215055 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:36.215070 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:36.215750 (+ 680us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:36.215872 (+ 122us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:36.215897 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:36.216018 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:36.216206 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 06:52:36.216537 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":339,"threads_started":1}
I20260809 06:52:36.217795 16733 log.cc:824] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:36.220912 16733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901: No bootstrap required, opened a new log
I20260809 06:52:36.221650 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:52:36.231340 16733 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e76d29b6ce404aad65a037b0e24901" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 35063 } }
I20260809 06:52:36.231698 16733 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:36.231801 16733 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e76d29b6ce404aad65a037b0e24901, State: Initialized, Role: FOLLOWER
I20260809 06:52:36.232432 16733 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e76d29b6ce404aad65a037b0e24901" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 35063 } }
I20260809 06:52:36.232671 16733 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:36.232821 16733 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:36.233009 16733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:36.235105 16733 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e76d29b6ce404aad65a037b0e24901" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 35063 } }
I20260809 06:52:36.235626 16733 leader_election.cc:302] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2e76d29b6ce404aad65a037b0e24901; no voters:
I20260809 06:52:36.236222 16733 leader_election.cc:288] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:36.236405 16738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:36.237134 16738 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [term 1 LEADER]: Becoming Leader. State: Replica: d2e76d29b6ce404aad65a037b0e24901, State: Running, Role: LEADER
I20260809 06:52:36.237686 16738 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e76d29b6ce404aad65a037b0e24901" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 35063 } }
I20260809 06:52:36.238452 16733 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:36.240581 16741 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2e76d29b6ce404aad65a037b0e24901" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e76d29b6ce404aad65a037b0e24901" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 35063 } } }
I20260809 06:52:36.240974 16741 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:36.241429 16742 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2e76d29b6ce404aad65a037b0e24901. Latest consensus state: current_term: 1 leader_uuid: "d2e76d29b6ce404aad65a037b0e24901" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e76d29b6ce404aad65a037b0e24901" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 35063 } } }
I20260809 06:52:36.241727 16742 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:36.248068 16747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:36.253137 16747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:36.261494 16747 catalog_manager.cc:1347] Generated new cluster ID: 77a03b6f7a804263afe09a471ae1df5a
I20260809 06:52:36.261615 16747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:36.268651 16747 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:36.270402 16747 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:36.285889 16747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2e76d29b6ce404aad65a037b0e24901: Generated new TSK 0
I20260809 06:52:36.286777 16747 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 06:52:36.321954 16765 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 06:52:36.322090 16765 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 06:52:36.323302 16736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:36.303613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43402 (local address 127.10.205.126:35063)
0809 06:52:36.303804 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:36.303811 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:36.304109 (+ 298us) server_negotiation.cc:407] Connection header received
0809 06:52:36.304339 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:36.304346 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:36.304440 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:36.304629 (+ 189us) server_negotiation.cc:226] Negotiated authn=JWT
0809 06:52:36.305063 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:36.306206 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:36.307532 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:36.308206 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:36.308399 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:36.308866 (+ 467us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 06:52:36.322615 (+ 13749us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 06:52:36.322991 (+ 376us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43402: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 06:52:36.323323 16764 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:52:36.303418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:35063 (local address 127.0.0.1:43402)
0809 06:52:36.304013 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:36.304028 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:36.304141 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:36.304618 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:36.304622 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:36.304632 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0809 06:52:36.304894 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:36.304902 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:36.306343 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:36.306346 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:36.307391 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:36.307401 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:36.308430 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:36.308434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:36.308571 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:36.308601 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 06:52:36.322829 (+ 14228us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 06:52:36.323004 (+ 175us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.205.126:35063: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":320,"threads_started":1}
W20260809 06:52:36.323426 16736 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43402: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260809 06:52:36.325150 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 16662
I20260809 06:52:36.326267 16728 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:36.416931 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 16662
2026-08-09T06:52:36Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (730 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 06:52:36.475088 11061 mini_oidc.cc:152] Starting JWKS server
I20260809 06:52:36.477123 11061 webserver.cc:460] Webserver started at https://127.0.0.1:35703/ using document root <none> and password file <none>
I20260809 06:52:36.477365 11061 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 06:52:36.478022 11061 webserver.cc:460] Webserver started at http://127.0.0.1:41103/ using document root <none> and password file <none>
2026-08-09T06:52:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:36Z Disabled control of system clock
I20260809 06:52:36.511231 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:46631
--webserver_interface=127.10.205.126
--webserver_port=0
--builtin_ntp_servers=127.10.205.84:45641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:46631
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35703/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 06:52:36.833550 16772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:36.833909 16772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:36.834067 16772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:36.841285 16772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:36.841434 16772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:36.841521 16772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:36.841626 16772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:36.841709 16772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 06:52:36.841797 16772 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 06:52:36.841873 16772 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35703/jwks.json
I20260809 06:52:36.850765 16772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:45641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:46631
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:46631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35703/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:36.852123 16772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:36.853932 16772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:36.865896 16778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:36.865944 16780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:36.865975 16777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:36.867122 16772 server_base.cc:1034] running on GCE node
I20260809 06:52:36.867900 16772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:36.869426 16772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:36.870648 16772 hybrid_clock.cc:648] HybridClock initialized: now 1786258356870602 us; error 36 us; skew 500 ppm
I20260809 06:52:36.871009 16772 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:52:36.873443 16772 webserver.cc:460] Webserver started at http://127.10.205.126:44061/ using document root <none> and password file <none>
I20260809 06:52:36.874171 16772 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:36.874346 16772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:36.874706 16772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:36.877700 16772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "de7ee906fe9d4f78a8d37c4639137559"
format_stamp: "Formatted at 2026-08-09 06:52:36 on dist-test-slave-0b58"
server_key: "dd6ff495dddc5f10c9730e2a08afa321"
server_key_iv: "2490d24689ec226db049341d413a8a3b"
server_key_version: "encryptionkey@0"
I20260809 06:52:36.878582 16772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "de7ee906fe9d4f78a8d37c4639137559"
format_stamp: "Formatted at 2026-08-09 06:52:36 on dist-test-slave-0b58"
server_key: "dd6ff495dddc5f10c9730e2a08afa321"
server_key_iv: "2490d24689ec226db049341d413a8a3b"
server_key_version: "encryptionkey@0"
I20260809 06:52:36.883787 16772 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:52:36.887223 16786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:36.888598 16772 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:36.888800 16772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "de7ee906fe9d4f78a8d37c4639137559"
format_stamp: "Formatted at 2026-08-09 06:52:36 on dist-test-slave-0b58"
server_key: "dd6ff495dddc5f10c9730e2a08afa321"
server_key_iv: "2490d24689ec226db049341d413a8a3b"
server_key_version: "encryptionkey@0"
I20260809 06:52:36.889030 16772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:36.906157 16772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:36.907038 16772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:36.907372 16772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:36.926244 16772 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:46631
I20260809 06:52:36.926265 16841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:46631 every 8 connection(s)
I20260809 06:52:36.927626 16772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:36.931195 16842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:36.932415 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 16772
I20260809 06:52:36.932621 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:36.933488 11061 external_mini_cluster.cc:1428] Setting key f745debff7f6753ae35924002285890b
I20260809 06:52:36.944039 16842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559: Bootstrap starting.
I20260809 06:52:36.946693 16845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:36.935387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51554 (local address 127.10.205.126:46631)
0809 06:52:36.936525 (+ 1138us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:36.936536 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:36.936579 (+ 43us) server_negotiation.cc:407] Connection header received
0809 06:52:36.938172 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:36.938192 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:36.938650 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:36.939055 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:36.939602 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:36.941113 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:36.942427 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:36.943069 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:36.943266 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:36.944528 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:36.944536 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:36.944555 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:36.945039 (+ 484us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:36.945118 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:36.945145 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:36.945274 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:36.945454 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 06:52:36.945736 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":424,"threads_started":1}
I20260809 06:52:36.947243 16842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:36.948340 16842 log.cc:824] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:36.950495 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:52:36.951170 16842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559: No bootstrap required, opened a new log
I20260809 06:52:36.958534 16842 raft_consensus.cc:348] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de7ee906fe9d4f78a8d37c4639137559" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 46631 } }
I20260809 06:52:36.958920 16842 raft_consensus.cc:374] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:36.959024 16842 raft_consensus.cc:729] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ee906fe9d4f78a8d37c4639137559, State: Initialized, Role: FOLLOWER
I20260809 06:52:36.959613 16842 consensus_queue.cc:260] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de7ee906fe9d4f78a8d37c4639137559" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 46631 } }
I20260809 06:52:36.959846 16842 raft_consensus.cc:388] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:36.959992 16842 raft_consensus.cc:482] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:36.960172 16842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:36.962347 16842 raft_consensus.cc:504] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de7ee906fe9d4f78a8d37c4639137559" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 46631 } }
I20260809 06:52:36.962880 16842 leader_election.cc:302] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de7ee906fe9d4f78a8d37c4639137559; no voters:
I20260809 06:52:36.963496 16842 leader_election.cc:288] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:36.963644 16847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:36.964354 16847 raft_consensus.cc:686] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [term 1 LEADER]: Becoming Leader. State: Replica: de7ee906fe9d4f78a8d37c4639137559, State: Running, Role: LEADER
I20260809 06:52:36.964893 16847 consensus_queue.cc:237] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de7ee906fe9d4f78a8d37c4639137559" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 46631 } }
I20260809 06:52:36.965633 16842 sys_catalog.cc:564] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:36.968403 16850 sys_catalog.cc:455] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [sys.catalog]: SysCatalogTable state changed. Reason: New leader de7ee906fe9d4f78a8d37c4639137559. Latest consensus state: current_term: 1 leader_uuid: "de7ee906fe9d4f78a8d37c4639137559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de7ee906fe9d4f78a8d37c4639137559" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 46631 } } }
I20260809 06:52:36.968710 16850 sys_catalog.cc:458] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:36.968094 16849 sys_catalog.cc:455] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de7ee906fe9d4f78a8d37c4639137559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de7ee906fe9d4f78a8d37c4639137559" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 46631 } } }
I20260809 06:52:36.969429 16849 sys_catalog.cc:458] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:36.970955 16855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:36.976166 16855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:36.985526 16855 catalog_manager.cc:1347] Generated new cluster ID: d9d72de37d7a42edad6497606010ee30
I20260809 06:52:36.985656 16855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:37.019106 16855 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:37.020975 16855 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:37.027397 16855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de7ee906fe9d4f78a8d37c4639137559: Generated new TSK 0
I20260809 06:52:37.028425 16855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:52:37.059443 16845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:37.050762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51558 (local address 127.10.205.126:46631)
0809 06:52:37.050978 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:37.050986 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:37.051447 (+ 461us) server_negotiation.cc:407] Connection header received
0809 06:52:37.051674 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:37.051682 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:37.051789 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:37.051955 (+ 166us) server_negotiation.cc:226] Negotiated authn=JWT
0809 06:52:37.052517 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:37.053658 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:37.054964 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:37.055652 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:37.055772 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:37.056312 (+ 540us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 06:52:37.058760 (+ 2448us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35703/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 06:52:37.059101 (+ 341us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51558: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35703/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 06:52:37.059890 16845 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51558: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35703/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 06:52:37.061501 16872 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:52:37.050631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:46631 (local address 127.0.0.1:51558)
0809 06:52:37.051317 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:37.051354 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:37.051483 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:37.051981 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:37.051984 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:37.051994 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0809 06:52:37.052365 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:37.052375 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:37.053801 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:37.053805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:37.054831 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:37.054842 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:37.055847 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:37.055852 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:37.055983 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:37.056016 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 06:52:37.058985 (+ 2969us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35703/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 06:52:37.061074 (+ 2089us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.205.126:46631: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35703/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":547,"mutex_wait_us":1764,"thread_start_us":383,"threads_started":1}
I20260809 06:52:37.062884 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 16772
I20260809 06:52:37.064162 16837 generic_service.cc:196] Checking for leaks (request via RPC)
E20260809 06:52:37.071655 16873 webserver.cc:533] Webserver: sslize failed:
E20260809 06:52:37.071753 16873 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 06:52:37.162876 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 16772
2026-08-09T06:52:37Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (745 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T06:52:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:37Z Disabled control of system clock
I20260809 06:52:37.255342 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:42489
--webserver_interface=127.10.205.126
--webserver_port=0
--builtin_ntp_servers=127.10.205.84:36529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:42489
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/testchainca.cert with env {}
W20260809 06:52:37.586061 16878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:37.586391 16878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:37.586563 16878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:37.593822 16878 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:37.593941 16878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:37.594048 16878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:37.594154 16878 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:37.594231 16878 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 06:52:37.594355 16878 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 06:52:37.594403 16878 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 06:52:37.604810 16878 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:36529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:42489
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:42489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:37.606225 16878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:37.607597 16878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:37.619985 16883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:37.619926 16884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:37.619891 16886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:37.620855 16878 server_base.cc:1034] running on GCE node
I20260809 06:52:37.621641 16878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:37.622993 16878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:37.624188 16878 hybrid_clock.cc:648] HybridClock initialized: now 1786258357624141 us; error 34 us; skew 500 ppm
I20260809 06:52:37.624572 16878 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:52:37.626998 16878 webserver.cc:460] Webserver started at http://127.10.205.126:41105/ using document root <none> and password file <none>
I20260809 06:52:37.627691 16878 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:37.627807 16878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:37.628131 16878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:37.630946 16878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "e5007d167aea47c6b4984151dbc3fa1a"
format_stamp: "Formatted at 2026-08-09 06:52:37 on dist-test-slave-0b58"
server_key: "d966fdc0ac4408700189f0253f27414c"
server_key_iv: "4687b6f6bdb4f05252e2a9008460e1ee"
server_key_version: "encryptionkey@0"
I20260809 06:52:37.631711 16878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "e5007d167aea47c6b4984151dbc3fa1a"
format_stamp: "Formatted at 2026-08-09 06:52:37 on dist-test-slave-0b58"
server_key: "d966fdc0ac4408700189f0253f27414c"
server_key_iv: "4687b6f6bdb4f05252e2a9008460e1ee"
server_key_version: "encryptionkey@0"
I20260809 06:52:37.636884 16878 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260809 06:52:37.640205 16892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:37.641602 16878 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:52:37.641785 16878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "e5007d167aea47c6b4984151dbc3fa1a"
format_stamp: "Formatted at 2026-08-09 06:52:37 on dist-test-slave-0b58"
server_key: "d966fdc0ac4408700189f0253f27414c"
server_key_iv: "4687b6f6bdb4f05252e2a9008460e1ee"
server_key_version: "encryptionkey@0"
I20260809 06:52:37.642012 16878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:37.666719 16878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:37.667630 16878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:37.667922 16878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:37.686331 16878 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:42489
I20260809 06:52:37.686342 16947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:42489 every 8 connection(s)
I20260809 06:52:37.687686 16878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:37.688043 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 16878
I20260809 06:52:37.688272 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:37.689167 11061 external_mini_cluster.cc:1428] Setting key f34cd7ea866e225a2ba3da0f150d6b66
I20260809 06:52:37.691735 16948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:37.704908 16951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:37.691273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58372 (local address 127.10.205.126:42489)
0809 06:52:37.692482 (+ 1209us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:37.692497 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:37.692634 (+ 137us) server_negotiation.cc:407] Connection header received
0809 06:52:37.694769 (+ 2135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:37.694795 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:37.695370 (+ 575us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:37.695822 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:37.696368 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:37.698399 (+ 2031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:37.699641 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:37.700711 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:37.700893 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:37.702049 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:37.702061 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:37.702083 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:52:37.702810 (+ 727us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:37.702917 (+ 107us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:52:37.702948 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:37.703074 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:37.703246 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 06:52:37.703593 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":404,"threads_started":1}
I20260809 06:52:37.706532 16948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a: Bootstrap starting.
I20260809 06:52:37.708948 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:52:37.710309 16948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:37.711547 16948 log.cc:824] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:37.714375 16948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a: No bootstrap required, opened a new log
I20260809 06:52:37.721616 16948 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5007d167aea47c6b4984151dbc3fa1a" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42489 } }
I20260809 06:52:37.721992 16948 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:37.722142 16948 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5007d167aea47c6b4984151dbc3fa1a, State: Initialized, Role: FOLLOWER
I20260809 06:52:37.722697 16948 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5007d167aea47c6b4984151dbc3fa1a" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42489 } }
I20260809 06:52:37.722900 16948 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:37.722996 16948 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:37.723110 16948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:37.725189 16948 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5007d167aea47c6b4984151dbc3fa1a" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42489 } }
I20260809 06:52:37.725653 16948 leader_election.cc:302] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5007d167aea47c6b4984151dbc3fa1a; no voters:
I20260809 06:52:37.726233 16948 leader_election.cc:288] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:37.726408 16953 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:37.727097 16953 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [term 1 LEADER]: Becoming Leader. State: Replica: e5007d167aea47c6b4984151dbc3fa1a, State: Running, Role: LEADER
I20260809 06:52:37.727632 16953 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5007d167aea47c6b4984151dbc3fa1a" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42489 } }
I20260809 06:52:37.728355 16948 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:37.731261 16955 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5007d167aea47c6b4984151dbc3fa1a. Latest consensus state: current_term: 1 leader_uuid: "e5007d167aea47c6b4984151dbc3fa1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5007d167aea47c6b4984151dbc3fa1a" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42489 } } }
I20260809 06:52:37.731341 16954 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5007d167aea47c6b4984151dbc3fa1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5007d167aea47c6b4984151dbc3fa1a" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42489 } } }
I20260809 06:52:37.731738 16955 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:37.731762 16954 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:37.733219 16959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:37.738655 16959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:37.747906 16959 catalog_manager.cc:1347] Generated new cluster ID: 3643b7164a1b4d9ca2f6f60dad4ea2b2
I20260809 06:52:37.748042 16959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:37.758322 16959 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:37.759501 16959 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:37.766620 16959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5007d167aea47c6b4984151dbc3fa1a: Generated new TSK 0
I20260809 06:52:37.767416 16959 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:52:38.229032 16951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:37.785884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58386 (local address 127.10.205.126:42489)
0809 06:52:37.786101 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:37.786109 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:37.786531 (+ 422us) server_negotiation.cc:407] Connection header received
0809 06:52:37.786797 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:37.786801 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:37.786874 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:37.787032 (+ 158us) server_negotiation.cc:226] Negotiated authn=JWT
0809 06:52:37.787503 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:37.788220 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:37.789649 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:37.790126 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:37.790284 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:37.790827 (+ 543us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 06:52:38.228215 (+437388us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 06:52:38.228732 (+ 517us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58386: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 06:52:38.229321 16978 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:52:37.785802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:42489 (local address 127.0.0.1:58386)
0809 06:52:37.786427 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:37.786444 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:37.786605 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:37.787047 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:37.787051 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:37.787063 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0809 06:52:37.787341 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:37.787351 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:37.788424 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:37.788429 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:37.789493 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:37.789504 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:37.790371 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:37.790377 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:37.790519 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:37.790553 (+ 34us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 06:52:38.228578 (+438025us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 06:52:38.228896 (+ 318us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.205.126:42489: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":362,"threads_started":1}
W20260809 06:52:38.229482 16951 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58386: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260809 06:52:38.231027 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 16878
I20260809 06:52:38.232118 16943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:38.335047 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 16878
2026-08-09T06:52:38Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1155 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (425 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (428 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:52:39 dist-test-slave-0b58 krb5kdc[16993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:52:39 dist-test-slave-0b58 krb5kdc[16993](info): set up 2 sockets
Aug 09 06:52:39 dist-test-slave-0b58 krb5kdc[16993](info): commencing operation
krb5kdc: starting...
W20260809 06:52:40.323776 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.001s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:52:40 dist-test-slave-0b58 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:52:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:52:40.595666 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:32905
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:32905
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:40.934469 17006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:40.934769 17006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:40.934859 17006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:40.942432 17006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:40.942554 17006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:40.942600 17006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:40.942670 17006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:40.942709 17006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:40.952863 17006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:32905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:32905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:40.954264 17006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:40.955596 17006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:40.967423 17012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:40.967347 17013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:40.967403 17015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:40.968577 17006 server_base.cc:1034] running on GCE node
I20260809 06:52:40.969362 17006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:40.970912 17006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:40.972157 17006 hybrid_clock.cc:648] HybridClock initialized: now 1786258360972101 us; error 38 us; skew 500 ppm
I20260809 06:52:40.972534 17006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:40 dist-test-slave-0b58 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258360, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:40.975697 17006 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:52:40.977293 17006 webserver.cc:460] Webserver started at http://127.10.205.126:45397/ using document root <none> and password file <none>
I20260809 06:52:40.977995 17006 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:40.978149 17006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:40.978472 17006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:40.981647 17006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "9c659239912c40fdbb99abf8a016c312"
format_stamp: "Formatted at 2026-08-09 06:52:40 on dist-test-slave-0b58"
server_key: "22be69d63f220db5350550ed831bdacd"
server_key_iv: "88d490269dc3ee8d6ed45d5ca2bb6bc1"
server_key_version: "encryptionkey@0"
I20260809 06:52:40.982448 17006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "9c659239912c40fdbb99abf8a016c312"
format_stamp: "Formatted at 2026-08-09 06:52:40 on dist-test-slave-0b58"
server_key: "22be69d63f220db5350550ed831bdacd"
server_key_iv: "88d490269dc3ee8d6ed45d5ca2bb6bc1"
server_key_version: "encryptionkey@0"
I20260809 06:52:40.987677 17006 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260809 06:52:40.991120 17022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:40.992566 17006 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:40.992763 17006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "9c659239912c40fdbb99abf8a016c312"
format_stamp: "Formatted at 2026-08-09 06:52:40 on dist-test-slave-0b58"
server_key: "22be69d63f220db5350550ed831bdacd"
server_key_iv: "88d490269dc3ee8d6ed45d5ca2bb6bc1"
server_key_version: "encryptionkey@0"
I20260809 06:52:40.992975 17006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:41.014606 17006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:41.018870 17006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:41.019182 17006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:41.037750 17006 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:32905
I20260809 06:52:41.037781 17076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:32905 every 8 connection(s)
I20260809 06:52:41.039252 17006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:41.042161 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 17006
I20260809 06:52:41.042423 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:41.043107 11061 external_mini_cluster.cc:1428] Setting key 089443fc1508279f1f2f7ac7a931f0e7
I20260809 06:52:41.043236 17077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:41.057745 17077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312: Bootstrap starting.
Aug 09 06:52:41 dist-test-slave-0b58 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:41.061132 17077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:41.062294 17077 log.cc:824] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:41.065389 17077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312: No bootstrap required, opened a new log
I20260809 06:52:41.069375 17081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:41.045073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49262 (local address 127.10.205.126:32905)
0809 06:52:41.048876 (+ 3803us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:41.048889 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:41.049451 (+ 562us) server_negotiation.cc:407] Connection header received
0809 06:52:41.051474 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:41.051502 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:41.051933 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:41.052381 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:41.053880 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:41.055199 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:41.056486 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:41.057192 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:41.057407 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:41.061648 (+ 4241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:41.061656 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:41.061676 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:41.061717 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:41.064980 (+ 3263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:41.065781 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:41.065788 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:41.065797 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:41.065979 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:41.066426 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:41.066430 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:41.066432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:41.066988 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:41.067355 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:41.067838 (+ 483us) server_negotiation.cc:299] Negotiation successful
0809 06:52:41.068361 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3569,"thread_start_us":3343,"threads_started":1}
I20260809 06:52:41.073596 17077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c659239912c40fdbb99abf8a016c312" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 32905 } }
I20260809 06:52:41.074172 17077 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:41.074290 17077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c659239912c40fdbb99abf8a016c312, State: Initialized, Role: FOLLOWER
I20260809 06:52:41.074972 17077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c659239912c40fdbb99abf8a016c312" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 32905 } }
I20260809 06:52:41.075235 17077 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:41.075388 17077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:41.075568 17077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:41.077876 17077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c659239912c40fdbb99abf8a016c312" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 32905 } }
I20260809 06:52:41.078419 17077 leader_election.cc:302] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c659239912c40fdbb99abf8a016c312; no voters:
I20260809 06:52:41.079032 17077 leader_election.cc:288] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:41.079188 17083 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:41.079878 17083 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [term 1 LEADER]: Becoming Leader. State: Replica: 9c659239912c40fdbb99abf8a016c312, State: Running, Role: LEADER
I20260809 06:52:41.080430 17083 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c659239912c40fdbb99abf8a016c312" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 32905 } }
I20260809 06:52:41.081290 17077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:41.083369 17084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c659239912c40fdbb99abf8a016c312" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c659239912c40fdbb99abf8a016c312" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 32905 } } }
I20260809 06:52:41.083283 17085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c659239912c40fdbb99abf8a016c312. Latest consensus state: current_term: 1 leader_uuid: "9c659239912c40fdbb99abf8a016c312" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c659239912c40fdbb99abf8a016c312" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 32905 } } }
I20260809 06:52:41.083706 17085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:41.083703 17084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:41.085947 17090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:41.090629 17090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:41.099001 17090 catalog_manager.cc:1347] Generated new cluster ID: 3e1721efd564437a94481c469e8de253
I20260809 06:52:41.099135 17090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:41.110318 17090 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:41.112357 17090 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:41.119069 17090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c659239912c40fdbb99abf8a016c312: Generated new TSK 0
I20260809 06:52:41.120105 17090 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:52:41.179924 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:32905
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:41.515923 17105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:41.516224 17105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:41.516402 17105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:41.523772 17105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:41.523918 17105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:41.524039 17105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:52:41.533694 17105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:32905
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:41.535099 17105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:41.536412 17105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:41.549592 17111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:41.549655 17112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:41.549592 17114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:41.550493 17105 server_base.cc:1034] running on GCE node
I20260809 06:52:41.551141 17105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:41.552155 17105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:41.553359 17105 hybrid_clock.cc:648] HybridClock initialized: now 1786258361553302 us; error 49 us; skew 500 ppm
I20260809 06:52:41.553694 17105 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:41 dist-test-slave-0b58 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258361, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:41.557087 17105 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:52:41.558609 17105 webserver.cc:460] Webserver started at http://127.10.205.65:46717/ using document root <none> and password file <none>
I20260809 06:52:41.559333 17105 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:41.559510 17105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:41.559823 17105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:41.562901 17105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "d3609dfe81f448bea311d83688539ba3"
format_stamp: "Formatted at 2026-08-09 06:52:41 on dist-test-slave-0b58"
server_key: "e71cebae8ab84e5c4ba42503dd8b9d40"
server_key_iv: "2ed01be1ceaeaf85560bcdc9533e12bc"
server_key_version: "encryptionkey@0"
I20260809 06:52:41.563730 17105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "d3609dfe81f448bea311d83688539ba3"
format_stamp: "Formatted at 2026-08-09 06:52:41 on dist-test-slave-0b58"
server_key: "e71cebae8ab84e5c4ba42503dd8b9d40"
server_key_iv: "2ed01be1ceaeaf85560bcdc9533e12bc"
server_key_version: "encryptionkey@0"
I20260809 06:52:41.569429 17105 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 06:52:41.573118 17122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:41.574460 17105 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:52:41.574646 17105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "d3609dfe81f448bea311d83688539ba3"
format_stamp: "Formatted at 2026-08-09 06:52:41 on dist-test-slave-0b58"
server_key: "e71cebae8ab84e5c4ba42503dd8b9d40"
server_key_iv: "2ed01be1ceaeaf85560bcdc9533e12bc"
server_key_version: "encryptionkey@0"
I20260809 06:52:41.574878 17105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:41.591527 17105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:41.596030 17105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:41.596437 17105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:41.597532 17105 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:41.598965 17105 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:41.599074 17105 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:41.599232 17105 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:41.599304 17105 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:41.633096 17105 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:39667
I20260809 06:52:41.633145 17238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:39667 every 8 connection(s)
I20260809 06:52:41.634442 17105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:52:41.636117 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 17105
I20260809 06:52:41.636399 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:52:41.637192 11061 external_mini_cluster.cc:1428] Setting key cd36c184a0926476618e0f29f7a1b76a
Aug 09 06:52:41 dist-test-slave-0b58 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258361, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:41.655730 17242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:41.637149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:44955 (local address 127.10.205.126:32905)
0809 06:52:41.638187 (+ 1038us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:41.638193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:41.639252 (+ 1059us) server_negotiation.cc:407] Connection header received
0809 06:52:41.640973 (+ 1721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:41.640979 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:41.641097 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:41.641258 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:41.642901 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:41.643646 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:41.645296 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:41.645708 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:41.645865 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:41.649827 (+ 3962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:41.649832 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:41.649835 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:41.649870 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:41.652620 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:41.653367 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:41.653371 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:41.653374 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:41.653490 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:41.653944 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:41.653955 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:41.653958 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:41.654246 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:41.654398 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:41.655124 (+ 726us) server_negotiation.cc:299] Negotiation successful
0809 06:52:41.655370 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":900,"thread_start_us":748,"threads_started":1}
I20260809 06:52:41.656859 17243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:41.637855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:32905 (local address 127.10.205.65:44955)
0809 06:52:41.638773 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:41.638820 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:41.640692 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:41.641529 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:41.641539 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:41.642135 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:41.642718 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:41.642736 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:41.643831 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:41.643835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:41.645132 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:41.645144 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:41.645972 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:41.645982 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:41.646240 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:41.646962 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:41.646984 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:41.649580 (+ 2596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:41.652777 (+ 3197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:41.652786 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:41.652803 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:41.653224 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:41.653603 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:41.653609 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:41.653612 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:41.653819 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:41.654371 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:41.654379 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:41.654741 (+ 362us) client_negotiation.cc:769] Sending connection context
0809 06:52:41.655003 (+ 262us) client_negotiation.cc:240] Negotiation successful
0809 06:52:41.655559 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":384,"threads_started":1}
I20260809 06:52:41.658615 17239 heartbeater.cc:347] Connected to a master server at 127.10.205.126:32905
I20260809 06:52:41.658946 17239 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:41.659694 17239 heartbeater.cc:511] Master 127.10.205.126:32905 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
I20260809 06:52:41.662145 17041 ts_manager.cc:194] Registered new tserver with Master: d3609dfe81f448bea311d83688539ba3 (127.10.205.65:39667)
I20260809 06:52:41.663630 17041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:44955
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:52:41.695359 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:32905
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:42.026875 17247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:42.027163 17247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:42.027364 17247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:42.034663 17247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:42.034781 17247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:42.034945 17247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:52:42.044968 17247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:32905
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:42.046232 17247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:42.047540 17247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:42.060803 17255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:42.060864 17252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:42.060824 17253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:42.061722 17247 server_base.cc:1034] running on GCE node
I20260809 06:52:42.062327 17247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:42.063253 17247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:42.064495 17247 hybrid_clock.cc:648] HybridClock initialized: now 1786258362064448 us; error 37 us; skew 500 ppm
I20260809 06:52:42.064792 17247 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:42.068053 17247 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:52:42.069576 17247 webserver.cc:460] Webserver started at http://127.10.205.66:39987/ using document root <none> and password file <none>
I20260809 06:52:42.070236 17247 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:42.070354 17247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:42.070623 17247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:42.073688 17247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "cbd58fd0ec124cf2acfcd41c2739646d"
format_stamp: "Formatted at 2026-08-09 06:52:42 on dist-test-slave-0b58"
server_key: "f37dee47d9849be1918b3b4699000431"
server_key_iv: "567351af2f799b974d5f8ef4128c7feb"
server_key_version: "encryptionkey@0"
I20260809 06:52:42.074481 17247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "cbd58fd0ec124cf2acfcd41c2739646d"
format_stamp: "Formatted at 2026-08-09 06:52:42 on dist-test-slave-0b58"
server_key: "f37dee47d9849be1918b3b4699000431"
server_key_iv: "567351af2f799b974d5f8ef4128c7feb"
server_key_version: "encryptionkey@0"
I20260809 06:52:42.079963 17247 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 06:52:42.083523 17262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:42.084981 17247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 06:52:42.085121 17247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "cbd58fd0ec124cf2acfcd41c2739646d"
format_stamp: "Formatted at 2026-08-09 06:52:42 on dist-test-slave-0b58"
server_key: "f37dee47d9849be1918b3b4699000431"
server_key_iv: "567351af2f799b974d5f8ef4128c7feb"
server_key_version: "encryptionkey@0"
I20260809 06:52:42.085371 17247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:42.107398 17247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:42.111595 17247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:42.111907 17247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:42.112949 17247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:42.114336 17247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:42.114454 17247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:42.114600 17247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:42.114677 17247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:42.149665 17247 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:34501
I20260809 06:52:42.149724 17381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:34501 every 8 connection(s)
I20260809 06:52:42.151122 17247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:52:42.161368 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 17247
I20260809 06:52:42.161602 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:52:42.162065 11061 external_mini_cluster.cc:1428] Setting key d957c46df3aeb1cbbba1116cb32a2e1b
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:42.172313 17242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:42.153924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:58281 (local address 127.10.205.126:32905)
0809 06:52:42.154113 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:42.154118 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:42.155359 (+ 1241us) server_negotiation.cc:407] Connection header received
0809 06:52:42.157332 (+ 1973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:42.157337 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:42.157432 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:42.157547 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:42.159234 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.159957 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.161574 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.162078 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.162213 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:42.166283 (+ 4070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:42.166288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:42.166292 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:42.166326 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:42.169088 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.169867 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.169879 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.169882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.170010 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.170477 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.170481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.170483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.170762 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:42.170932 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:42.171678 (+ 746us) server_negotiation.cc:299] Negotiation successful
0809 06:52:42.171928 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:52:42.173364 17385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:42.154414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:32905 (local address 127.10.205.66:58281)
0809 06:52:42.155188 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:42.155233 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:42.157042 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:42.157846 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:42.157860 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:42.158457 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:42.159023 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:42.159040 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.160128 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.160131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:42.161426 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:42.161438 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.162323 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.162331 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:42.162568 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:42.163459 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:42.163490 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:42.166033 (+ 2543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:42.169240 (+ 3207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:42.169251 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:42.169269 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:42.169724 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:42.170126 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:42.170132 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:42.170135 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:42.170345 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:42.170905 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:42.170913 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:42.171295 (+ 382us) client_negotiation.cc:769] Sending connection context
0809 06:52:42.171574 (+ 279us) client_negotiation.cc:240] Negotiation successful
0809 06:52:42.172143 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":309,"threads_started":1}
I20260809 06:52:42.175000 17383 heartbeater.cc:347] Connected to a master server at 127.10.205.126:32905
I20260809 06:52:42.175320 17383 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:42.176059 17383 heartbeater.cc:511] Master 127.10.205.126:32905 requested a full tablet report, sending...
I20260809 06:52:42.177700 17041 ts_manager.cc:194] Registered new tserver with Master: cbd58fd0ec124cf2acfcd41c2739646d (127.10.205.66:34501)
I20260809 06:52:42.178634 17041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:58281
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:52:42.221360 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:32905
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:42.558627 17389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:42.558944 17389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:42.559054 17389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:42.566533 17389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:42.566645 17389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:42.566761 17389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:52:42.577380 17389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:32905
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:42.578830 17389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:42.580355 17389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:42.594224 17394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:42.594184 17397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:42.594288 17395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:42.595501 17389 server_base.cc:1034] running on GCE node
I20260809 06:52:42.596069 17389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:42.597121 17389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:42.598328 17389 hybrid_clock.cc:648] HybridClock initialized: now 1786258362598270 us; error 52 us; skew 500 ppm
I20260809 06:52:42.598611 17389 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:42.601740 17389 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:52:42.603227 17389 webserver.cc:460] Webserver started at http://127.10.205.67:37425/ using document root <none> and password file <none>
I20260809 06:52:42.603942 17389 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:42.604081 17389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:42.604475 17389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:42.607481 17389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "eec86db4ea234469b591d072c2363b36"
format_stamp: "Formatted at 2026-08-09 06:52:42 on dist-test-slave-0b58"
server_key: "fb6563b73a329f2a35068194a666be7e"
server_key_iv: "883f75cbeae8048d0e5299a2c1e72349"
server_key_version: "encryptionkey@0"
I20260809 06:52:42.608348 17389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "eec86db4ea234469b591d072c2363b36"
format_stamp: "Formatted at 2026-08-09 06:52:42 on dist-test-slave-0b58"
server_key: "fb6563b73a329f2a35068194a666be7e"
server_key_iv: "883f75cbeae8048d0e5299a2c1e72349"
server_key_version: "encryptionkey@0"
I20260809 06:52:42.613441 17389 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 06:52:42.616915 17404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:42.618219 17389 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:52:42.618404 17389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "eec86db4ea234469b591d072c2363b36"
format_stamp: "Formatted at 2026-08-09 06:52:42 on dist-test-slave-0b58"
server_key: "fb6563b73a329f2a35068194a666be7e"
server_key_iv: "883f75cbeae8048d0e5299a2c1e72349"
server_key_version: "encryptionkey@0"
I20260809 06:52:42.618613 17389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:42.644137 17389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:42.648166 17389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:42.648515 17389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:42.649525 17389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:42.650898 17389 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:42.651005 17389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:42.651162 17389 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:42.651237 17389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:42.666561 17239 heartbeater.cc:503] Master 127.10.205.126:32905 was elected leader, sending a full tablet report...
I20260809 06:52:42.685724 17389 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:43021
I20260809 06:52:42.685832 17523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:43021 every 8 connection(s)
I20260809 06:52:42.687119 17389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:52:42.689872 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 17389
I20260809 06:52:42.690107 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:52:42.690727 11061 external_mini_cluster.cc:1428] Setting key d14f499d1018b5001f2cabbe8c4c9454
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:52:42.707851 17526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:42.689859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:51689 (local address 127.10.205.126:32905)
0809 06:52:42.690583 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:42.690592 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:42.691520 (+ 928us) server_negotiation.cc:407] Connection header received
0809 06:52:42.693482 (+ 1962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:42.693488 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:42.693583 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:42.693700 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:42.695254 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.696041 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.697785 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.698184 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.698281 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:42.701682 (+ 3401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:42.701687 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:42.701691 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:42.701725 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:42.704196 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.705266 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.705271 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.705275 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.705460 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.705988 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.705993 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.705996 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.706367 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:42.706488 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:42.707383 (+ 895us) server_negotiation.cc:299] Negotiation successful
0809 06:52:42.707561 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":467,"threads_started":1}
I20260809 06:52:42.708916 17527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:42.690515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:32905 (local address 127.10.205.67:51689)
0809 06:52:42.691352 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:42.691407 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:42.693219 (+ 1812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:42.693993 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:42.694001 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:42.694520 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:42.695105 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:42.695122 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.696180 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.696184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:42.697634 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:42.697646 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.698380 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.698385 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:42.698578 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:42.699223 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:42.699244 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:42.701472 (+ 2228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:42.704416 (+ 2944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:42.704424 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:42.704442 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:42.705148 (+ 706us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:42.705587 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:42.705592 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:42.705596 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:42.705850 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:42.706552 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:42.706563 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:42.707006 (+ 443us) client_negotiation.cc:769] Sending connection context
0809 06:52:42.707256 (+ 250us) client_negotiation.cc:240] Negotiation successful
0809 06:52:42.707685 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":365,"threads_started":1}
I20260809 06:52:42.710233 17524 heartbeater.cc:347] Connected to a master server at 127.10.205.126:32905
I20260809 06:52:42.710559 17524 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:42.711268 17524 heartbeater.cc:511] Master 127.10.205.126:32905 requested a full tablet report, sending...
I20260809 06:52:42.712689 17041 ts_manager.cc:194] Registered new tserver with Master: eec86db4ea234469b591d072c2363b36 (127.10.205.67:43021)
I20260809 06:52:42.713559 17041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:51689
I20260809 06:52:42.719208 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/test-admin.keytab.
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:42.751505 11061 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 06:52:42.756996 17532 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:52:42.754415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56514 (local address 127.10.205.65:39667)
0809 06:52:42.755072 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:42.755080 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:42.755108 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:52:42.755173 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:42.755181 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:42.755393 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:42.755525 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:42.756526 (+ 1001us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56514: BlockingRecv error: recv got EOF from 127.0.0.1:56514 (error 108)
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":338,"threads_started":1}
W20260809 06:52:42.757200 11061 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/krb5cc' of type FILE
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:42.758877 11061 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:42.760372 11061 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:52:42.776180 17532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:42.762032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56516 (local address 127.10.205.65:39667)
0809 06:52:42.762266 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:42.762272 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:42.762480 (+ 208us) server_negotiation.cc:407] Connection header received
0809 06:52:42.762613 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:42.762616 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:42.762678 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:42.762762 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:42.763750 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.764807 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.766007 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.766613 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.766717 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:42.770346 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:42.770359 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:42.770375 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:42.770412 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:42.773469 (+ 3057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.774291 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.774306 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.774308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.774427 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.774762 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.774767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.774769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.775177 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:42.775405 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:42.775621 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 06:52:42.775874 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260809 06:52:42.782497 17532 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:52:42.780579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56526 (local address 127.10.205.65:39667)
0809 06:52:42.780809 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:42.780815 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:42.781052 (+ 237us) server_negotiation.cc:407] Connection header received
0809 06:52:42.781251 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:42.781255 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:42.781330 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:42.781431 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:42.782249 (+ 818us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56526: BlockingRecv error: recv got EOF from 127.0.0.1:56526 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 06:52:42.782722 11061 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/krb5cc' of type FILE
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:42.784364 11061 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:42.785842 11061 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:52:42.799849 17532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:42.787179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56528 (local address 127.10.205.65:39667)
0809 06:52:42.787411 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:42.787417 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:42.787644 (+ 227us) server_negotiation.cc:407] Connection header received
0809 06:52:42.787767 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:42.787771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:42.787837 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:42.787914 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:42.789150 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.789854 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.791076 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.791487 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.791586 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:42.795012 (+ 3426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:42.795016 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:42.795019 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:42.795063 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:42.797627 (+ 2564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.798231 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.798235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.798237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.798357 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.798707 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.798710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.798712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.798973 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:42.799171 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:42.799362 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 06:52:42.799506 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
W20260809 06:52:42.804260 17532 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:52:42.802438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56536 (local address 127.10.205.65:39667)
0809 06:52:42.802674 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:42.802680 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:42.802966 (+ 286us) server_negotiation.cc:407] Connection header received
0809 06:52:42.803138 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:42.803143 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:42.803221 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:42.803331 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:42.804026 (+ 695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56536: BlockingRecv error: recv got EOF from 127.0.0.1:56536 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260809 06:52:42.804867 11061 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786258311159624-11061-0/krb5kdc/krb5cc)
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:42.806402 11061 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:42.807688 11061 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:52:42.822237 17532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:42.809092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56538 (local address 127.10.205.65:39667)
0809 06:52:42.809290 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:42.809295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:42.809505 (+ 210us) server_negotiation.cc:407] Connection header received
0809 06:52:42.809616 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:42.809619 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:42.809672 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:42.809745 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:42.810620 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.811306 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.812534 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.812945 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.813035 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:42.817206 (+ 4171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:42.817211 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:42.817214 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:42.817246 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:42.819647 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.820493 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.820497 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.820499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.820653 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.820996 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.820999 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.821001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.821275 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:42.821498 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:42.821682 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 06:52:42.821882 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:52:42.823927 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 17105
I20260809 06:52:42.834841 17532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:42.824600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56548 (local address 127.10.205.65:39667)
0809 06:52:42.824747 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:42.824751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:42.825084 (+ 333us) server_negotiation.cc:407] Connection header received
0809 06:52:42.825193 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:42.825196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:42.825246 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:42.825320 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:42.826174 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.826830 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.827965 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.828478 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.828569 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:42.830487 (+ 1918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:42.830491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:42.830494 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:42.830519 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:42.832713 (+ 2194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.833234 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.833238 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.833240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.833357 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.833658 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.833661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.833663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.833899 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:42.834086 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:42.834325 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 06:52:42.834499 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 06:52:42.835376 17234 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:42.919195 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 17105
I20260809 06:52:42.938755 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 17247
Aug 09 06:52:42 dist-test-slave-0b58 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:52:42.953895 17545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:42.939728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53058 (local address 127.10.205.66:34501)
0809 06:52:42.940359 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:42.940365 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:42.940392 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:52:42.940455 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:42.940461 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:42.940704 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:42.940831 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:42.941845 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.942851 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.944009 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:42.944636 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:42.944733 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:42.948449 (+ 3716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:42.948461 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:42.948488 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:42.948530 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:42.951208 (+ 2678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.951851 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.951858 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.951860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.951987 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:42.952417 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:42.952420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:42.952422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:42.952786 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:42.953018 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:42.953279 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 06:52:42.953469 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":312,"threads_started":1}
I20260809 06:52:42.955224 17377 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:43.037817 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 17247
I20260809 06:52:43.056613 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 17389
Aug 09 06:52:43 dist-test-slave-0b58 krb5kdc[16993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:52:43.073050 17547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:43.057682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56048 (local address 127.10.205.67:43021)
0809 06:52:43.058355 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:43.058362 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:43.058391 (+ 29us) server_negotiation.cc:407] Connection header received
0809 06:52:43.058451 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:43.058457 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:43.058676 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:43.058807 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:43.059874 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:43.061001 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:43.062369 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:43.062926 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:43.063019 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:43.067255 (+ 4236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:43.067267 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:43.067282 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:43.067317 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:43.070359 (+ 3042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:43.071001 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:43.071009 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:43.071011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:43.071132 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:43.071489 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:43.071492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:43.071494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:43.071834 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:43.072069 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:43.072404 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 06:52:43.072713 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":349,"threads_started":1}
I20260809 06:52:43.074461 17519 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:43.156594 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 17389
I20260809 06:52:43.175786 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 17006
I20260809 06:52:43.177193 17072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:43.282553 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 17006
2026-08-09T06:52:43Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4097 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:52:43 dist-test-slave-0b58 krb5kdc[17552](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:52:43 dist-test-slave-0b58 krb5kdc[17552](info): set up 2 sockets
Aug 09 06:52:43 dist-test-slave-0b58 krb5kdc[17552](info): commencing operation
krb5kdc: starting...
W20260809 06:52:44.411926 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.003s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:52:44 dist-test-slave-0b58 krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:52:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:44Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.126.keytab.
Entry for principal oryx/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.126.keytab.
I20260809 06:52:44.671952 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:45343
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.126.keytab
--principal=oryx/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:41229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:45343
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:45.001257 17566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:45.001649 17566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:45.001864 17566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:45.009266 17566 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:45.009442 17566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:45.009557 17566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:45.009665 17566 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:45.009757 17566 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:45.019922 17566 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:41229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:45343
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.126.keytab
--principal=oryx/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:45343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:45.021414 17566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:45.022861 17566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:45.035238 17572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:45.035580 17575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:45.035583 17573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:45.036724 17566 server_base.cc:1034] running on GCE node
I20260809 06:52:45.037657 17566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:45.039177 17566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:45.040370 17566 hybrid_clock.cc:648] HybridClock initialized: now 1786258365040319 us; error 40 us; skew 500 ppm
I20260809 06:52:45.040740 17566 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:45 dist-test-slave-0b58 krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258365, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:45.043843 17566 init.cc:377] Logged in from keytab as oryx/127.10.205.126@KRBTEST.COM (short username oryx)
I20260809 06:52:45.045447 17566 webserver.cc:460] Webserver started at http://127.10.205.126:45471/ using document root <none> and password file <none>
I20260809 06:52:45.046135 17566 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:45.046242 17566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:45.046517 17566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:45.049659 17566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "101ca3fbfe034a68b712a15edf416cc8"
format_stamp: "Formatted at 2026-08-09 06:52:45 on dist-test-slave-0b58"
server_key: "6a9d6d9279b27d4fde27114537f61c24"
server_key_iv: "27425baae1a1dcc6251d17f369557f5b"
server_key_version: "encryptionkey@0"
I20260809 06:52:45.050418 17566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "101ca3fbfe034a68b712a15edf416cc8"
format_stamp: "Formatted at 2026-08-09 06:52:45 on dist-test-slave-0b58"
server_key: "6a9d6d9279b27d4fde27114537f61c24"
server_key_iv: "27425baae1a1dcc6251d17f369557f5b"
server_key_version: "encryptionkey@0"
I20260809 06:52:45.055830 17566 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:52:45.059342 17582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:45.060771 17566 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:45.060976 17566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "101ca3fbfe034a68b712a15edf416cc8"
format_stamp: "Formatted at 2026-08-09 06:52:45 on dist-test-slave-0b58"
server_key: "6a9d6d9279b27d4fde27114537f61c24"
server_key_iv: "27425baae1a1dcc6251d17f369557f5b"
server_key_version: "encryptionkey@0"
I20260809 06:52:45.061190 17566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:45.082187 17566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:45.086504 17566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:45.086827 17566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:45.106652 17566 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:45343
I20260809 06:52:45.106676 17636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:45343 every 8 connection(s)
I20260809 06:52:45.108112 17566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:45.109289 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 17566
I20260809 06:52:45.109575 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:45.110235 11061 external_mini_cluster.cc:1428] Setting key 40b747b853985765f40d3b6f1ddc360e
I20260809 06:52:45.112673 17637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 06:52:45 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:45.126531 17637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8: Bootstrap starting.
I20260809 06:52:45.130899 17637 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:45.132431 17637 log.cc:824] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:45.135052 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:45.112411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59112 (local address 127.10.205.126:45343)
0809 06:52:45.113243 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:45.113256 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:45.113305 (+ 49us) server_negotiation.cc:407] Connection header received
0809 06:52:45.114949 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:45.114971 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:45.115371 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:45.115703 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:45.117701 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:45.119070 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:45.120882 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:45.121545 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:45.121671 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:45.126436 (+ 4765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:45.126447 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:45.126467 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:45.126528 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:45.130517 (+ 3989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:45.131279 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:45.131291 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:45.131311 (+ 20us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:45.131571 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:45.131957 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:45.131964 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:45.131987 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:45.132799 (+ 812us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:45.133234 (+ 435us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:45.133625 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 06:52:45.133973 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":401,"threads_started":1}
I20260809 06:52:45.135847 17637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8: No bootstrap required, opened a new log
I20260809 06:52:45.143973 17637 raft_consensus.cc:348] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } }
I20260809 06:52:45.144557 17637 raft_consensus.cc:374] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:45.144707 17637 raft_consensus.cc:729] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 101ca3fbfe034a68b712a15edf416cc8, State: Initialized, Role: FOLLOWER
I20260809 06:52:45.145306 17637 consensus_queue.cc:260] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } }
I20260809 06:52:45.145567 17637 raft_consensus.cc:388] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:45.145725 17637 raft_consensus.cc:482] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:45.145910 17637 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:45.148152 17637 raft_consensus.cc:504] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } }
I20260809 06:52:45.148700 17637 leader_election.cc:302] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 101ca3fbfe034a68b712a15edf416cc8; no voters:
I20260809 06:52:45.149441 17637 leader_election.cc:288] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:45.149572 17642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:45.150808 17642 raft_consensus.cc:686] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 1 LEADER]: Becoming Leader. State: Replica: 101ca3fbfe034a68b712a15edf416cc8, State: Running, Role: LEADER
I20260809 06:52:45.151424 17642 consensus_queue.cc:237] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } }
I20260809 06:52:45.152004 17637 sys_catalog.cc:564] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:45.154686 17643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } }
I20260809 06:52:45.154735 17644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 101ca3fbfe034a68b712a15edf416cc8. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } }
I20260809 06:52:45.155094 17644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:45.155094 17643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:45.156044 17651 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:45.168725 17651 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:45.178524 17651 catalog_manager.cc:1347] Generated new cluster ID: 644831ef554146cc8c7cace8637951b2
I20260809 06:52:45.178671 17651 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:45.192292 17651 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:45.193701 17651 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:45.202327 17651 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8: Generated new TSK 0
I20260809 06:52:45.203325 17651 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab.
Entry for principal oryx/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab.
I20260809 06:52:45.282286 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:45343
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab
--principal=oryx/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:41229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:45.624229 17665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:45.624593 17665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:45.624775 17665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:45.632900 17665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:45.633033 17665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:45.633231 17665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:52:45.643465 17665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:41229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab
--principal=oryx/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:45343
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:45.644901 17665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:45.646416 17665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:45.661115 17670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:45.661115 17671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:45.661805 17673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:45.662421 17665 server_base.cc:1034] running on GCE node
I20260809 06:52:45.663079 17665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:45.664100 17665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:45.665333 17665 hybrid_clock.cc:648] HybridClock initialized: now 1786258365665266 us; error 96 us; skew 500 ppm
I20260809 06:52:45.665674 17665 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:45 dist-test-slave-0b58 krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258365, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:45.675420 17665 init.cc:377] Logged in from keytab as oryx/127.10.205.65@KRBTEST.COM (short username oryx)
I20260809 06:52:45.677134 17665 webserver.cc:460] Webserver started at http://127.10.205.65:33629/ using document root <none> and password file <none>
I20260809 06:52:45.677848 17665 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:45.677954 17665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:45.678220 17665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:45.681286 17665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "d2118f5e30354ee5bfa22b07a088cf77"
format_stamp: "Formatted at 2026-08-09 06:52:45 on dist-test-slave-0b58"
server_key: "0bc4c79012404f1e1552a078eae55f12"
server_key_iv: "b37a155cca9f5e21233d7978c7c2af58"
server_key_version: "encryptionkey@0"
I20260809 06:52:45.682053 17665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "d2118f5e30354ee5bfa22b07a088cf77"
format_stamp: "Formatted at 2026-08-09 06:52:45 on dist-test-slave-0b58"
server_key: "0bc4c79012404f1e1552a078eae55f12"
server_key_iv: "b37a155cca9f5e21233d7978c7c2af58"
server_key_version: "encryptionkey@0"
I20260809 06:52:45.687314 17665 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:52:45.690783 17680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:45.692109 17665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:52:45.692305 17665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "d2118f5e30354ee5bfa22b07a088cf77"
format_stamp: "Formatted at 2026-08-09 06:52:45 on dist-test-slave-0b58"
server_key: "0bc4c79012404f1e1552a078eae55f12"
server_key_iv: "b37a155cca9f5e21233d7978c7c2af58"
server_key_version: "encryptionkey@0"
I20260809 06:52:45.692521 17665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:45.707647 17665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:45.712158 17665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:45.712540 17665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:45.713578 17665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:45.714979 17665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:45.715056 17665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:45.715211 17665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:45.715279 17665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:45.750903 17665 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:34113
I20260809 06:52:45.750949 17802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:34113 every 8 connection(s)
I20260809 06:52:45.752345 17665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:52:45.758749 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 17665
I20260809 06:52:45.759035 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:52:45.759737 11061 external_mini_cluster.cc:1428] Setting key 21eeedba386a65343f788a52c0cf7538
Aug 09 06:52:45 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258365, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:45.775952 17806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:45.754889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:53529 (local address 127.10.205.126:45343)
0809 06:52:45.755358 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:45.755365 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:45.756357 (+ 992us) server_negotiation.cc:407] Connection header received
0809 06:52:45.758452 (+ 2095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:45.758460 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:45.758565 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:45.758706 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:45.760529 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:45.761414 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:45.763959 (+ 2545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:45.764408 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:45.764509 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:45.768930 (+ 4421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:45.768938 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:45.768946 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:45.768996 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:45.772503 (+ 3507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:45.773509 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:45.773513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:45.773515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:45.773632 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:45.774183 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:45.774186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:45.774188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:45.774466 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:45.774577 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:45.775494 (+ 917us) server_negotiation.cc:299] Negotiation successful
0809 06:52:45.775673 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":219,"threads_started":1}
I20260809 06:52:45.777757 17808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:45.755465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.65:53529)
0809 06:52:45.756162 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:45.756206 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:45.758151 (+ 1945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:45.759022 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:45.759031 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:45.759608 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:45.760235 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:45.760304 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:45.761633 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:45.761637 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:45.763794 (+ 2157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:45.763813 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:45.764636 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:45.764646 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:45.764986 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:45.765814 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:45.765848 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:45.768666 (+ 2818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:45.772663 (+ 3997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:45.772677 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:45.772699 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:45.773381 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:45.773750 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:45.773757 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:45.773761 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:45.774066 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:45.774594 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:45.774605 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:45.775094 (+ 489us) client_negotiation.cc:769] Sending connection context
0809 06:52:45.775397 (+ 303us) client_negotiation.cc:240] Negotiation successful
0809 06:52:45.776031 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":274,"threads_started":1}
I20260809 06:52:45.779430 17804 heartbeater.cc:347] Connected to a master server at 127.10.205.126:45343
I20260809 06:52:45.779747 17804 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:45.780570 17804 heartbeater.cc:511] Master 127.10.205.126:45343 requested a full tablet report, sending...
I20260809 06:52:45.782735 17599 ts_manager.cc:194] Registered new tserver with Master: d2118f5e30354ee5bfa22b07a088cf77 (127.10.205.65:34113)
I20260809 06:52:45.784235 17599 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:53529
WARNING: no policy specified for oryx/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab.
Entry for principal oryx/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab.
I20260809 06:52:45.821058 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:45343
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab
--principal=oryx/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:41229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:46.159926 17811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:46.160306 17811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:46.160483 17811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:46.168597 17811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:46.168761 17811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:46.168960 17811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:52:46.179471 17811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:41229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab
--principal=oryx/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:45343
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:46.180917 17811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:46.182404 17811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:46.196547 17819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:46.196623 17817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:46.196579 17816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:46.201850 17811 server_base.cc:1034] running on GCE node
I20260809 06:52:46.202652 17811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:46.203619 17811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:46.204859 17811 hybrid_clock.cc:648] HybridClock initialized: now 1786258366204809 us; error 46 us; skew 500 ppm
I20260809 06:52:46.205191 17811 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:46 dist-test-slave-0b58 krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258366, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:46.208459 17811 init.cc:377] Logged in from keytab as oryx/127.10.205.66@KRBTEST.COM (short username oryx)
I20260809 06:52:46.209933 17811 webserver.cc:460] Webserver started at http://127.10.205.66:45067/ using document root <none> and password file <none>
I20260809 06:52:46.210739 17811 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:46.210891 17811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:46.211210 17811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:46.214357 17811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "82dbd80f566f4508a0cfc45c590dac21"
format_stamp: "Formatted at 2026-08-09 06:52:46 on dist-test-slave-0b58"
server_key: "69455233922272fb7252061f06bd2ccb"
server_key_iv: "66c7e42f70baca073fe1e707b651223d"
server_key_version: "encryptionkey@0"
I20260809 06:52:46.215233 17811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "82dbd80f566f4508a0cfc45c590dac21"
format_stamp: "Formatted at 2026-08-09 06:52:46 on dist-test-slave-0b58"
server_key: "69455233922272fb7252061f06bd2ccb"
server_key_iv: "66c7e42f70baca073fe1e707b651223d"
server_key_version: "encryptionkey@0"
I20260809 06:52:46.220695 17811 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 06:52:46.225333 17827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:46.227357 17811 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:52:46.227550 17811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "82dbd80f566f4508a0cfc45c590dac21"
format_stamp: "Formatted at 2026-08-09 06:52:46 on dist-test-slave-0b58"
server_key: "69455233922272fb7252061f06bd2ccb"
server_key_iv: "66c7e42f70baca073fe1e707b651223d"
server_key_version: "encryptionkey@0"
I20260809 06:52:46.227823 17811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:46.241394 17811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:46.245347 17811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:46.245597 17811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:46.246542 17811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:46.248019 17811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:46.248093 17811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:46.248179 17811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:46.248229 17811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:46.282490 17811 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:41835
I20260809 06:52:46.282536 17947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:41835 every 8 connection(s)
I20260809 06:52:46.283844 17811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:52:46.289001 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 17811
I20260809 06:52:46.289212 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:52:46.289672 11061 external_mini_cluster.cc:1428] Setting key 436f7819b80858d158782c352c9706e1
Aug 09 06:52:46 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258366, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:46.305788 17950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:46.286454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:58393 (local address 127.10.205.126:45343)
0809 06:52:46.286923 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:46.286930 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:46.287949 (+ 1019us) server_negotiation.cc:407] Connection header received
0809 06:52:46.289969 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:46.289976 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:46.290073 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:46.290193 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:46.292197 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:46.293252 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:46.294786 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:46.295497 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:46.295632 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:46.299152 (+ 3520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:46.299160 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:46.299167 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:46.299212 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:46.302416 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:46.303397 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:46.303401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:46.303403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:46.303557 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:46.304057 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:46.304060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:46.304061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:46.304380 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:46.304489 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:46.305381 (+ 892us) server_negotiation.cc:299] Negotiation successful
0809 06:52:46.305536 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":211,"threads_started":1}
I20260809 06:52:46.307484 17951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:46.287040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.66:58393)
0809 06:52:46.287778 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:46.287830 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:46.289647 (+ 1817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:46.290477 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:46.290489 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:46.291218 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:46.292034 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:46.292055 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:46.293398 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:46.293402 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:46.294633 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:46.294646 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:46.295701 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:46.295706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:46.295906 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:46.296648 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:46.296670 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:46.298918 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:46.302578 (+ 3660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:46.302589 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:46.302607 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:46.303283 (+ 676us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:46.303666 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:46.303673 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:46.303680 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:46.303955 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:46.304498 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:46.304509 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:46.304993 (+ 484us) client_negotiation.cc:769] Sending connection context
0809 06:52:46.305317 (+ 324us) client_negotiation.cc:240] Negotiation successful
0809 06:52:46.305920 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":296,"threads_started":1}
I20260809 06:52:46.309145 17948 heartbeater.cc:347] Connected to a master server at 127.10.205.126:45343
I20260809 06:52:46.309456 17948 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:46.310245 17948 heartbeater.cc:511] Master 127.10.205.126:45343 requested a full tablet report, sending...
I20260809 06:52:46.311818 17599 ts_manager.cc:194] Registered new tserver with Master: 82dbd80f566f4508a0cfc45c590dac21 (127.10.205.66:41835)
I20260809 06:52:46.312691 17599 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:58393
WARNING: no policy specified for oryx/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab.
Entry for principal oryx/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab.
I20260809 06:52:46.351138 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:45343
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab
--principal=oryx/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:41229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:46.693454 17954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:46.693805 17954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:46.693980 17954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:46.701768 17954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:46.701937 17954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:46.702123 17954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:52:46.712227 17954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:41229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab
--principal=oryx/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:45343
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:46.713739 17954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:46.715111 17954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:46.728875 17959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:46.728820 17960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:46.729417 17962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:46.730078 17954 server_base.cc:1034] running on GCE node
I20260809 06:52:46.730742 17954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:46.731788 17954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:46.732993 17954 hybrid_clock.cc:648] HybridClock initialized: now 1786258366732919 us; error 65 us; skew 500 ppm
I20260809 06:52:46.733351 17954 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:46 dist-test-slave-0b58 krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258366, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:46.736658 17954 init.cc:377] Logged in from keytab as oryx/127.10.205.67@KRBTEST.COM (short username oryx)
I20260809 06:52:46.738266 17954 webserver.cc:460] Webserver started at http://127.10.205.67:38577/ using document root <none> and password file <none>
I20260809 06:52:46.739014 17954 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:46.739173 17954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:46.739511 17954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:46.742707 17954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "0cdb3675201d49ce8963d7c62d33497a"
format_stamp: "Formatted at 2026-08-09 06:52:46 on dist-test-slave-0b58"
server_key: "8ace1bd880d3870ae46db5275df503c0"
server_key_iv: "d7a70dd4e39ebf2ff050951bcb54ccca"
server_key_version: "encryptionkey@0"
I20260809 06:52:46.743587 17954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "0cdb3675201d49ce8963d7c62d33497a"
format_stamp: "Formatted at 2026-08-09 06:52:46 on dist-test-slave-0b58"
server_key: "8ace1bd880d3870ae46db5275df503c0"
server_key_iv: "d7a70dd4e39ebf2ff050951bcb54ccca"
server_key_version: "encryptionkey@0"
I20260809 06:52:46.749074 17954 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 06:52:46.752987 17970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:46.754500 17954 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 06:52:46.754695 17954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "0cdb3675201d49ce8963d7c62d33497a"
format_stamp: "Formatted at 2026-08-09 06:52:46 on dist-test-slave-0b58"
server_key: "8ace1bd880d3870ae46db5275df503c0"
server_key_iv: "d7a70dd4e39ebf2ff050951bcb54ccca"
server_key_version: "encryptionkey@0"
I20260809 06:52:46.754914 17954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:46.773205 17954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:46.777921 17954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:46.778252 17954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:46.779300 17954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:46.780875 17954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:46.780987 17954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:46.781149 17954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:46.781225 17954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:46.787417 17804 heartbeater.cc:503] Master 127.10.205.126:45343 was elected leader, sending a full tablet report...
I20260809 06:52:46.816493 17954 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:37399
I20260809 06:52:46.816529 18091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:37399 every 8 connection(s)
I20260809 06:52:46.817857 17954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:52:46.818235 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 17954
I20260809 06:52:46.818447 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:52:46.819119 11061 external_mini_cluster.cc:1428] Setting key a0e431f2aaf9ad20ce479f0d77df29ea
Aug 09 06:52:46 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258366, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:46.840179 18094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:46.820793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:56413 (local address 127.10.205.126:45343)
0809 06:52:46.821312 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:46.821318 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:46.822573 (+ 1255us) server_negotiation.cc:407] Connection header received
0809 06:52:46.824586 (+ 2013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:46.824590 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:46.824668 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:46.824765 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:46.826311 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:46.827098 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:46.829210 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:46.829902 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:46.830043 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:46.834737 (+ 4694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:46.834741 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:46.834744 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:46.834780 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:46.837484 (+ 2704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:46.838182 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:46.838185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:46.838188 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:46.838307 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:46.838702 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:46.838705 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:46.838707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:46.838972 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:46.839088 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:46.839733 (+ 645us) server_negotiation.cc:299] Negotiation successful
0809 06:52:46.839908 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":275,"threads_started":1}
I20260809 06:52:46.841250 18095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:46.821545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.67:56413)
0809 06:52:46.822395 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:46.822454 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:46.824315 (+ 1861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:46.824993 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:46.825001 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:46.825539 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:46.826153 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:46.826173 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:46.827249 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:46.827253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:46.829062 (+ 1809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:46.829075 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:46.830381 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:46.830389 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:46.830775 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:46.831603 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:46.831626 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:46.834508 (+ 2882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:46.837614 (+ 3106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:46.837622 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:46.837635 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:46.838071 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:46.838401 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:46.838404 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:46.838407 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:46.838604 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:46.839075 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:46.839081 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:46.839408 (+ 327us) client_negotiation.cc:769] Sending connection context
0809 06:52:46.839636 (+ 228us) client_negotiation.cc:240] Negotiation successful
0809 06:52:46.840034 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":316,"threads_started":1}
I20260809 06:52:46.842778 18092 heartbeater.cc:347] Connected to a master server at 127.10.205.126:45343
I20260809 06:52:46.843099 18092 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:46.843873 18092 heartbeater.cc:511] Master 127.10.205.126:45343 requested a full tablet report, sending...
I20260809 06:52:46.845403 17599 ts_manager.cc:194] Registered new tserver with Master: 0cdb3675201d49ce8963d7c62d33497a (127.10.205.67:37399)
I20260809 06:52:46.846319 17599 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:56413
I20260809 06:52:46.847954 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.205.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.125.keytab.
Entry for principal oryx/127.10.205.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.125.keytab.
I20260809 06:52:46.907965 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.125:42637
--webserver_interface=127.10.205.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.125.keytab
--principal=oryx/127.10.205.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:41229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:45343,127.10.205.125:42637
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:47.247120 18098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:47.247435 18098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:47.247609 18098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:47.255169 18098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:47.255295 18098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:47.255381 18098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:47.255482 18098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:47.255544 18098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:47.266091 18098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:41229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:45343,127.10.205.125:42637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.125.keytab
--principal=oryx/127.10.205.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.125:42637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.205.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
W20260809 06:52:47.266526 18098 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.10.205.126:45343,127.10.205.125:42637'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 06:52:47.267657 18098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:47.269033 18098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:47.281474 18105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:47.281497 18107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:47.282564 18098 server_base.cc:1034] running on GCE node
W20260809 06:52:47.281562 18104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:47.287139 18098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:47.288744 18098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:47.289981 18098 hybrid_clock.cc:648] HybridClock initialized: now 1786258367289925 us; error 44 us; skew 500 ppm
I20260809 06:52:47.290366 18098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:47 dist-test-slave-0b58 krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258367, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:47.293861 18098 init.cc:377] Logged in from keytab as oryx/127.10.205.125@KRBTEST.COM (short username oryx)
I20260809 06:52:47.295398 18098 webserver.cc:460] Webserver started at http://127.10.205.125:32901/ using document root <none> and password file <none>
I20260809 06:52:47.296104 18098 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:47.296248 18098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:47.296607 18098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:47.299736 18098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data/instance:
uuid: "1c5c422506294437bf14595e48292673"
format_stamp: "Formatted at 2026-08-09 06:52:47 on dist-test-slave-0b58"
server_key: "d4c45bf21f16168e298ee4973d753614"
server_key_iv: "8270edaea7b8b9753828c479162ae936"
server_key_version: "encryptionkey@0"
I20260809 06:52:47.300588 18098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/wal/instance:
uuid: "1c5c422506294437bf14595e48292673"
format_stamp: "Formatted at 2026-08-09 06:52:47 on dist-test-slave-0b58"
server_key: "d4c45bf21f16168e298ee4973d753614"
server_key_iv: "8270edaea7b8b9753828c479162ae936"
server_key_version: "encryptionkey@0"
I20260809 06:52:47.305954 18098 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:52:47.309366 18114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:47.310700 18098 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:52:47.310838 18098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/wal
uuid: "1c5c422506294437bf14595e48292673"
format_stamp: "Formatted at 2026-08-09 06:52:47 on dist-test-slave-0b58"
server_key: "d4c45bf21f16168e298ee4973d753614"
server_key_iv: "8270edaea7b8b9753828c479162ae936"
server_key_version: "encryptionkey@0"
I20260809 06:52:47.311025 18098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:47.315253 17948 heartbeater.cc:503] Master 127.10.205.126:45343 was elected leader, sending a full tablet report...
I20260809 06:52:47.340687 18098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:47.345301 18098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:47.345604 18098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:47.365304 18098 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.125:42637
I20260809 06:52:47.365252 18168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.125:42637 every 8 connection(s)
I20260809 06:52:47.366829 18098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
I20260809 06:52:47.370772 18169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:47.373864 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 18098
I20260809 06:52:47.379153 18169 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:52:47 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.205.125@KRBTEST.COM
Aug 09 06:52:47 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258367, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.125@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:47.397163 18173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.382462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59116 (local address 127.10.205.126:45343)
0809 06:52:47.382967 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:47.382973 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:47.383559 (+ 586us) server_negotiation.cc:407] Connection header received
0809 06:52:47.383745 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:47.383751 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:47.383843 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:47.383956 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:47.385145 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.385887 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.387306 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.387748 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.387878 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.391323 (+ 3445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:47.391328 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:47.391335 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:47.391376 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:47.394279 (+ 2903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.395024 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.395031 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.395036 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.395157 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.395541 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.395548 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.395551 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.395863 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:47.396015 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:47.396594 (+ 579us) server_negotiation.cc:299] Negotiation successful
0809 06:52:47.396825 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":251,"threads_started":1}
I20260809 06:52:47.398285 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.376236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47504 (local address 127.10.205.125:42637)
0809 06:52:47.377146 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:47.377163 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:47.377214 (+ 51us) server_negotiation.cc:407] Connection header received
0809 06:52:47.379536 (+ 2322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:47.379569 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:47.380139 (+ 570us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:47.380633 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:47.382256 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.384059 (+ 1803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.385432 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.386097 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.386361 (+ 264us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.391009 (+ 4648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:47.391017 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:47.391028 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:47.391058 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:47.393867 (+ 2809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.394546 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.394554 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.394557 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.394737 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.395119 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.395124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.395127 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.395744 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:47.396086 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:47.396486 (+ 400us) server_negotiation.cc:299] Negotiation successful
0809 06:52:47.396964 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":609,"thread_start_us":377,"threads_started":1}
I20260809 06:52:47.399037 18174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.382550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:59116)
0809 06:52:47.383403 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:47.383451 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:47.383609 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:47.384014 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:47.384018 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:47.384724 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:47.384987 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:47.384996 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.386032 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.386039 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:47.387158 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:47.387169 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.387983 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.387991 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:47.388137 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.388835 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:47.388856 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:47.391131 (+ 2275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:47.394423 (+ 3292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:47.394434 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:47.394446 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:47.394906 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:47.395277 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:47.395282 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:47.395286 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:47.395428 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:47.395999 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:47.396007 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:47.396193 (+ 186us) client_negotiation.cc:769] Sending connection context
0809 06:52:47.396571 (+ 378us) client_negotiation.cc:240] Negotiation successful
0809 06:52:47.398724 (+ 2153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":1736,"thread_start_us":458,"threads_started":1}
I20260809 06:52:47.400794 18169 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:52:47 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258367, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.125@KRBTEST.COM for oryx/127.10.205.125@KRBTEST.COM
I20260809 06:52:47.413168 18174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.401507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:42637 (local address 127.0.0.1:47520)
0809 06:52:47.401695 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:47.401716 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:47.401814 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:47.402092 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:47.402096 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:47.402470 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:47.402613 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:47.402622 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.403610 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.403615 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:47.404565 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:47.404582 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.405292 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.405297 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:47.405493 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.406033 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:47.406049 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:47.408136 (+ 2087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:47.411061 (+ 2925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:47.411065 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:47.411067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:47.411455 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:47.411780 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:47.411783 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:47.411786 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:47.411915 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:47.412457 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:47.412460 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:47.412583 (+ 123us) client_negotiation.cc:769] Sending connection context
0809 06:52:47.412694 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 06:52:47.412910 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 06:52:47.413434 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.401655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47520 (local address 127.10.205.125:42637)
0809 06:52:47.401793 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:47.401798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:47.401814 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:52:47.401930 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:47.401934 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:47.401983 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:47.402075 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:47.402752 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.403468 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.404732 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.405145 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.405272 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.408355 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:47.408360 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:47.408363 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:47.408392 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:47.410938 (+ 2546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.411552 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.411556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.411558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.411674 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.412005 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.412008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.412010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.412359 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:47.412476 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:47.412803 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 06:52:47.413025 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":44}
I20260809 06:52:47.418354 18169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: Bootstrap starting.
I20260809 06:52:47.421468 18169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:47.422456 18169 log.cc:824] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:47.425179 18169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: No bootstrap required, opened a new log
I20260809 06:52:47.432760 18169 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } }
I20260809 06:52:47.433115 18169 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:47.433188 18169 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5c422506294437bf14595e48292673, State: Initialized, Role: FOLLOWER
I20260809 06:52:47.433754 18169 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } }
I20260809 06:52:47.434671 18176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } } }
I20260809 06:52:47.435022 18176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:52:47.435735 18169 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 06:52:47.444612 18187 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:52:47.444788 18187 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:52:47.447414 18098 master_runner.cc:428] Detected that this master 1c5c422506294437bf14595e48292673 is joining an existing cluster
I20260809 06:52:47.447535 18098 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.205.125:42637
I20260809 06:52:47.454344 18176 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:47.454728 18176 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } }
I20260809 06:52:47.457037 18176 leader_election.cc:288] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343)
I20260809 06:52:47.457377 17609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c5c422506294437bf14595e48292673" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "101ca3fbfe034a68b712a15edf416cc8" is_pre_election: true
I20260809 06:52:47.459751 18116 leader_election.cc:302] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 1c5c422506294437bf14595e48292673; no voters: 101ca3fbfe034a68b712a15edf416cc8
I20260809 06:52:47.460808 18176 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 06:52:47.478581 18173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.451713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59124 (local address 127.10.205.126:45343)
0809 06:52:47.451929 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:47.451936 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:47.452662 (+ 726us) server_negotiation.cc:407] Connection header received
0809 06:52:47.452960 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:47.452966 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:47.453092 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:47.453187 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:47.461818 (+ 8631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.463316 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.466854 (+ 3538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.467628 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.467751 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.470876 (+ 3125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:47.470884 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:47.470892 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:47.470943 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:47.474830 (+ 3887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.475760 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.475766 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.475769 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.475935 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.476480 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.476488 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.476494 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.476960 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:47.477108 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:47.477823 (+ 715us) server_negotiation.cc:299] Negotiation successful
0809 06:52:47.478118 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 06:52:47.479986 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.452901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47526 (local address 127.10.205.125:42637)
0809 06:52:47.453062 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:47.453070 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:47.464343 (+ 11273us) server_negotiation.cc:407] Connection header received
0809 06:52:47.464600 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:47.464606 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:47.464692 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:47.464808 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:47.466461 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.467558 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.469618 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.470356 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.470461 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.473042 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:47.473049 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:47.473054 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:47.473089 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:47.476922 (+ 3833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.477760 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.477766 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.477770 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.477907 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.478318 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.478323 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.478326 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.478690 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:47.478839 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:47.479327 (+ 488us) server_negotiation.cc:299] Negotiation successful
0809 06:52:47.479584 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 06:52:47.480482 18195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.451720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:59124)
0809 06:52:47.452556 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:47.452576 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:47.452782 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:47.453426 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:47.453431 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:47.460309 (+ 6878us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:47.461551 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:47.461571 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.463567 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.463576 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:47.466635 (+ 3059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:47.466654 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.468141 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.468156 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:47.468408 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.469157 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:47.469186 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:47.470643 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:47.475014 (+ 4371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:47.475022 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:47.475027 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:47.475597 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:47.476087 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:47.476095 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:47.476101 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:47.476334 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:47.477204 (+ 870us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:47.477212 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:47.477480 (+ 268us) client_negotiation.cc:769] Sending connection context
0809 06:52:47.479199 (+ 1719us) client_negotiation.cc:240] Negotiation successful
0809 06:52:47.479822 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"mutex_wait_us":156,"spinlock_wait_cycles":28544,"thread_start_us":389,"threads_started":1}
I20260809 06:52:47.481392 18196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.453177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:42637 (local address 127.0.0.1:47526)
0809 06:52:47.464209 (+ 11032us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:47.464233 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:47.464426 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:47.464980 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:47.464985 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:47.465906 (+ 921us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:47.466297 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:47.466314 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.467812 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.467817 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:47.469464 (+ 1647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:47.469479 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.470760 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.470767 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:47.470961 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.471631 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:47.471655 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:47.472823 (+ 1168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:47.477072 (+ 4249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:47.477079 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:47.477088 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:47.477642 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:47.478035 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:47.478039 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:47.478043 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:47.478204 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:47.478905 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:47.478909 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:47.479067 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 06:52:47.480625 (+ 1558us) client_negotiation.cc:240] Negotiation successful
0809 06:52:47.480939 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10871,"thread_start_us":10668,"threads_started":1}
WARNING: no policy specified for oryx/127.10.205.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.124@KRBTEST.COM" created.
Aug 09 06:52:47 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258365, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.126@KRBTEST.COM for oryx/127.10.205.125@KRBTEST.COM
I20260809 06:52:47.505015 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.489019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47528 (local address 127.10.205.125:42637)
0809 06:52:47.489193 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:47.489200 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:47.489492 (+ 292us) server_negotiation.cc:407] Connection header received
0809 06:52:47.489908 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:47.489914 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:47.490022 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:47.490144 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:47.491431 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.492403 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.494045 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.494569 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.494740 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.498504 (+ 3764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:47.498510 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:47.498514 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:47.498550 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:47.501623 (+ 3073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.502465 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.502473 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.502481 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.502645 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.503069 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.503075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.503078 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.503358 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:47.503542 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:47.504339 (+ 797us) server_negotiation.cc:299] Negotiation successful
0809 06:52:47.504593 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:52:47.508415 18198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.488616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:42637 (local address 127.0.0.1:47528)
0809 06:52:47.489343 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:47.489399 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:47.489663 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:47.490239 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:47.490248 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:47.491002 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:47.491253 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:47.491264 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.492584 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.492590 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:47.493887 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:47.493900 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.494768 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.494774 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:47.494993 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.495765 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:47.495789 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:47.498272 (+ 2483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:47.501808 (+ 3536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:47.501825 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:47.501834 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:47.502328 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:47.502767 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:47.502772 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:47.502775 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:47.502953 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:47.503646 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:47.503659 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:47.503908 (+ 249us) client_negotiation.cc:769] Sending connection context
0809 06:52:47.504161 (+ 253us) client_negotiation.cc:240] Negotiation successful
0809 06:52:47.504619 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":581,"threads_started":1}
I20260809 06:52:47.511051 17599 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.205.125:42637: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "1c5c422506294437bf14595e48292673"
member_type: NON_VOTER
last_known_addr {
host: "127.10.205.125"
port: 42637
}
attrs {
promote: true
}
}
dest_uuid: "101ca3fbfe034a68b712a15edf416cc8"
cas_config_opid_index: -1
I20260809 06:52:47.512715 17599 consensus_queue.cc:237] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true } }
I20260809 06:52:47.522557 18202 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 1c5c422506294437bf14595e48292673 (127.10.205.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true } } }
I20260809 06:52:47.524120 18143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:47.527339 18202 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.205.125:42637
I20260809 06:52:47.528201 18143 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 FOLLOWER]: Refusing update from remote peer 101ca3fbfe034a68b712a15edf416cc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 06:52:47.528564 18098 master.cc:537] Master@127.10.205.125:42637 shutting down...
I20260809 06:52:47.528390 18201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true } } }
I20260809 06:52:47.528735 18201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:47.529995 18201 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.124.keytab.
Entry for principal oryx/127.10.205.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.124.keytab.
W20260809 06:52:47.534199 17584 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260809 06:52:47.535434 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.124:34223
--webserver_interface=127.10.205.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.124.keytab
--principal=oryx/127.10.205.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:41229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:45343,127.10.205.125:42637,127.10.205.124:34223
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:47.536598 17584 consensus_peers.cc:487] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 -> Peer 1c5c422506294437bf14595e48292673 (127.10.205.125:42637): Couldn't send request to peer 1c5c422506294437bf14595e48292673. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 06:52:47.544876 18098 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:47.545382 18098 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:47.545603 18098 tablet_replica.cc:330] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: stopping tablet replica
I20260809 06:52:47.552891 18098 master.cc:552] Master@127.10.205.125:42637 shutdown complete.
I20260809 06:52:47.553128 18098 master_runner.cc:305] Clearing existing system tablet
I20260809 06:52:47.553691 18098 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:47.553884 18098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:47.557067 18098 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:52:47.559037 18207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:47.559545 18098 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:47.560024 18098 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:52:47.560230 18098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/wal
uuid: "1c5c422506294437bf14595e48292673"
format_stamp: "Formatted at 2026-08-09 06:52:47 on dist-test-slave-0b58"
server_key: "d4c45bf21f16168e298ee4973d753614"
server_key_iv: "8270edaea7b8b9753828c479162ae936"
server_key_version: "encryptionkey@0"
I20260809 06:52:47.565723 18098 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:47.573089 18098 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 06:52:47.573315 18098 log.cc:1196] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 06:52:47.573773 18098 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: Deleting consensus metadata
I20260809 06:52:47.574079 18098 master_runner.cc:315] Copying system tablet from 127.10.205.126:45343
I20260809 06:52:47.576745 18098 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: tablet copy: Beginning tablet copy session from remote peer at address 127.10.205.126:45343
I20260809 06:52:47.595994 18173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.577662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59138 (local address 127.10.205.126:45343)
0809 06:52:47.577859 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:47.577865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:47.580902 (+ 3037us) server_negotiation.cc:407] Connection header received
0809 06:52:47.581113 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:47.581119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:47.581219 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:47.581337 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:47.582510 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.583629 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.585565 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.586264 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.586393 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.588892 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:47.588898 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:47.588903 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:47.588959 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:47.592686 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.593641 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.593647 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.593651 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.593809 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:47.594302 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:47.594307 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:47.594311 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:47.594698 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:47.594865 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:47.595372 (+ 507us) server_negotiation.cc:299] Negotiation successful
0809 06:52:47.595603 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 06:52:47.596560 18213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:47.577549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:59138)
0809 06:52:47.580728 (+ 3179us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:47.580763 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:47.580953 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:47.581397 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:47.581403 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:47.581979 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:47.582322 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:47.582336 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.583821 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.583828 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:47.585380 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:47.585396 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:47.586440 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:47.586447 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:47.586650 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:47.587394 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:47.587419 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:47.588667 (+ 1248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:47.592879 (+ 4212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:47.592886 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:47.592890 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:47.593472 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:47.593948 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:47.593955 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:47.593960 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:47.594158 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:47.594847 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:47.594852 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:47.595073 (+ 221us) client_negotiation.cc:769] Sending connection context
0809 06:52:47.595235 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 06:52:47.595586 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3030,"thread_start_us":2863,"threads_started":1}
I20260809 06:52:47.597524 17620 tablet_copy_service.cc:140] P 101ca3fbfe034a68b712a15edf416cc8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 1c5c422506294437bf14595e48292673 ({username='oryx', principal='oryx/127.10.205.125@KRBTEST.COM'} at 127.0.0.1:59138)
I20260809 06:52:47.597828 17620 tablet_copy_service.cc:161] P 101ca3fbfe034a68b712a15edf416cc8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 1c5c422506294437bf14595e48292673 at {username='oryx', principal='oryx/127.10.205.125@KRBTEST.COM'} at 127.0.0.1:59138: session id = 1c5c422506294437bf14595e48292673-00000000000000000000000000000000
I20260809 06:52:47.602504 17620 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 06:52:47.605279 18098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 06:52:47.612589 18098 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: tablet copy: Starting download of 0 data blocks...
I20260809 06:52:47.612962 18098 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: tablet copy: Starting download of 1 WAL segments...
I20260809 06:52:47.616097 18098 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 06:52:47.621012 17620 tablet_copy_service.cc:342] P 101ca3fbfe034a68b712a15edf416cc8: Request end of tablet copy session 1c5c422506294437bf14595e48292673-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.205.125@KRBTEST.COM'} at 127.0.0.1:59138
I20260809 06:52:47.621232 17620 tablet_copy_service.cc:433] P 101ca3fbfe034a68b712a15edf416cc8: ending tablet copy session 1c5c422506294437bf14595e48292673-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 1c5c422506294437bf14595e48292673
I20260809 06:52:47.634676 18098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:47.638044 18214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:47.638418 18215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:47.648453 18217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:47.648576 18098 server_base.cc:1034] running on GCE node
I20260809 06:52:47.649207 18098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:47.649871 18098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:47.651257 18098 hybrid_clock.cc:648] HybridClock initialized: now 1786258367651179 us; error 54 us; skew 500 ppm
I20260809 06:52:47.651485 18098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:47 dist-test-slave-0b58 krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258367, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:47.653797 18098 init.cc:377] Logged in from keytab as oryx/127.10.205.125@KRBTEST.COM (short username oryx)
I20260809 06:52:47.658469 18098 webserver.cc:460] Webserver started at http://127.10.205.125:41489/ using document root <none> and password file <none>
I20260809 06:52:47.658973 18098 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:47.659063 18098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:47.662535 18098 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:52:47.664535 18225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:47.665059 18098 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260809 06:52:47.665258 18098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/wal
uuid: "1c5c422506294437bf14595e48292673"
format_stamp: "Formatted at 2026-08-09 06:52:47 on dist-test-slave-0b58"
server_key: "d4c45bf21f16168e298ee4973d753614"
server_key_iv: "8270edaea7b8b9753828c479162ae936"
server_key_version: "encryptionkey@0"
I20260809 06:52:47.665428 18098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:47.708667 18098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:47.713389 18098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:47.740300 18098 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.125:42637
I20260809 06:52:47.740309 18279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.125:42637 every 8 connection(s)
I20260809 06:52:47.741554 18098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
I20260809 06:52:47.747335 18280 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:52:47.751834 18280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: Bootstrap starting.
I20260809 06:52:47.771097 18280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:52:47.771703 18280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: Bootstrap complete.
I20260809 06:52:47.772924 18280 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true } }
I20260809 06:52:47.773218 18280 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1c5c422506294437bf14595e48292673, State: Initialized, Role: LEARNER
I20260809 06:52:47.773543 18280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true } }
I20260809 06:52:47.774446 18283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true } } }
I20260809 06:52:47.774812 18280 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:47.774858 18283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: This master's current role is: LEARNER
I20260809 06:52:47.789137 18295 catalog_manager.cc:1259] Loaded cluster ID: 644831ef554146cc8c7cace8637951b2
I20260809 06:52:47.789294 18295 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: loading cluster ID for follower catalog manager: success
I20260809 06:52:47.792605 18295 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: acquiring CA information for follower catalog manager: success
I20260809 06:52:47.794754 18295 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:52:47.849208 18092 heartbeater.cc:503] Master 127.10.205.126:45343 was elected leader, sending a full tablet report...
W20260809 06:52:47.988324 18205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:47.988658 18205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:47.988812 18205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:47.996526 18205 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:47.996665 18205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:47.996752 18205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:47.996825 18205 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:47.996896 18205 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:48.007344 18205 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:41229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:45343,127.10.205.125:42637,127.10.205.124:34223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.124.keytab
--principal=oryx/127.10.205.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.124:34223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.205.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:48.008865 18205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:48.010270 18205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:48.022464 18302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:48.022531 18305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:48.022428 18303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:48.023398 18205 server_base.cc:1034] running on GCE node
I20260809 06:52:48.024217 18205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:48.025733 18205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:48.026974 18205 hybrid_clock.cc:648] HybridClock initialized: now 1786258368026931 us; error 36 us; skew 500 ppm
I20260809 06:52:48.027343 18205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:48 dist-test-slave-0b58 krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258368, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:48.030828 18205 init.cc:377] Logged in from keytab as oryx/127.10.205.124@KRBTEST.COM (short username oryx)
I20260809 06:52:48.032685 18205 webserver.cc:460] Webserver started at http://127.10.205.124:40965/ using document root <none> and password file <none>
I20260809 06:52:48.033516 18205 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:48.033668 18205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:48.034004 18205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:48.037333 18205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data/instance:
uuid: "290370fbd1d2488aa16e25d514a89532"
format_stamp: "Formatted at 2026-08-09 06:52:48 on dist-test-slave-0b58"
server_key: "a9775abc487890cfc71000b87f690789"
server_key_iv: "866429d15cebf3a625158cff186fd5da"
server_key_version: "encryptionkey@0"
I20260809 06:52:48.038179 18205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/wal/instance:
uuid: "290370fbd1d2488aa16e25d514a89532"
format_stamp: "Formatted at 2026-08-09 06:52:48 on dist-test-slave-0b58"
server_key: "a9775abc487890cfc71000b87f690789"
server_key_iv: "866429d15cebf3a625158cff186fd5da"
server_key_version: "encryptionkey@0"
I20260809 06:52:48.043879 18205 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:52:48.047449 18312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:48.048938 18205 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260809 06:52:48.049127 18205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/wal
uuid: "290370fbd1d2488aa16e25d514a89532"
format_stamp: "Formatted at 2026-08-09 06:52:48 on dist-test-slave-0b58"
server_key: "a9775abc487890cfc71000b87f690789"
server_key_iv: "866429d15cebf3a625158cff186fd5da"
server_key_version: "encryptionkey@0"
I20260809 06:52:48.049343 18205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:48.067440 18205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:48.072389 18205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:48.072696 18205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:48.092216 18205 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.124:34223
I20260809 06:52:48.092240 18364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.124:34223 every 8 connection(s)
I20260809 06:52:48.093849 18205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
I20260809 06:52:48.097878 18365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:48.099462 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 18205
I20260809 06:52:48.107106 18365 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:52:48 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.205.124@KRBTEST.COM
Aug 09 06:52:48 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258368, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.124@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:48.126791 18368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.101754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34232 (local address 127.10.205.124:34223)
0809 06:52:48.102537 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:48.102552 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:48.102594 (+ 42us) server_negotiation.cc:407] Connection header received
0809 06:52:48.104595 (+ 2001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:48.104618 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:48.105028 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:48.105429 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:48.107314 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.109295 (+ 1981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.111212 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.112193 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.112382 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.118135 (+ 5753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:48.118143 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:48.118153 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:48.118189 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:48.122153 (+ 3964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.122975 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.122984 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.122993 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.123197 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.123612 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.123617 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.123620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.124132 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:48.124503 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:48.124986 (+ 483us) server_negotiation.cc:299] Negotiation successful
0809 06:52:48.125455 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":338,"threads_started":1}
I20260809 06:52:48.130777 18370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.110238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:59146)
0809 06:52:48.113793 (+ 3555us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:48.113844 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:48.113997 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:48.114966 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:48.114977 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:48.115628 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:48.115886 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.115894 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.117297 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.117303 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.119066 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.119080 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.120085 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.120091 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.120353 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.121006 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:48.121028 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:48.123444 (+ 2416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:48.127718 (+ 4274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.127745 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.127752 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.128382 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.128813 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.128816 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.128818 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.128953 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.129593 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:48.129599 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:48.129773 (+ 174us) client_negotiation.cc:769] Sending connection context
0809 06:52:48.130004 (+ 231us) client_negotiation.cc:240] Negotiation successful
0809 06:52:48.130371 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3273,"thread_start_us":3098,"threads_started":1}
I20260809 06:52:48.131352 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.110275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59146 (local address 127.10.205.126:45343)
0809 06:52:48.114595 (+ 4320us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:48.114600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:48.114635 (+ 35us) server_negotiation.cc:407] Connection header received
0809 06:52:48.114685 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:48.114689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:48.114755 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:48.114898 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:48.116054 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.117136 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.119224 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.119897 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.120044 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.123632 (+ 3588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:48.123638 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:48.123642 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:48.123689 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:48.127581 (+ 3892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.128504 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.128509 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.128512 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.128689 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.129080 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.129085 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.129088 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.129464 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:48.129616 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:48.130612 (+ 996us) server_negotiation.cc:299] Negotiation successful
0809 06:52:48.131093 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4222,"thread_start_us":4110,"threads_started":1}
I20260809 06:52:48.132889 18365 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:52:48.139688 18374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.131698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:42637 (local address 127.0.0.1:47544)
0809 06:52:48.132226 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:48.132247 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:48.132396 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:48.133273 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:48.133277 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:48.133304 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:48.133495 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.133502 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.135381 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.135387 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.137248 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.137261 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.138843 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.138849 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.139060 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.139116 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 06:52:48.139192 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 06:52:48.139290 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":377,"threads_started":1}
I20260809 06:52:48.139760 18375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.131941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47544 (local address 127.10.205.125:42637)
0809 06:52:48.132759 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:48.132763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:48.132779 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:52:48.132834 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:48.132838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:48.132951 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:48.133085 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:48.133738 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.135204 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.137439 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.138645 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.138816 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.139021 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:48.139250 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 06:52:48.139439 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":662,"thread_start_us":536,"threads_started":1}
I20260809 06:52:48.140738 18254 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260809 06:52:48.141295 18283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 101ca3fbfe034a68b712a15edf416cc8. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true } } }
I20260809 06:52:48.141597 18283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: This master's current role is: LEARNER
Aug 09 06:52:48 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258368, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.124@KRBTEST.COM for oryx/127.10.205.125@KRBTEST.COM
I20260809 06:52:48.147477 18370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.133519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:42637 (local address 127.0.0.1:47554)
0809 06:52:48.133753 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:48.133771 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:48.133867 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:48.134650 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:48.134655 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:48.135083 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:48.135261 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.135275 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.136803 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.136807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.138061 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.138076 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.138899 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.138906 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.139120 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.139842 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:48.140191 (+ 349us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:48.142562 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:48.145476 (+ 2914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.145479 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.145482 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.145859 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.146216 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.146219 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.146221 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.146355 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.146803 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:48.146806 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:48.146923 (+ 117us) client_negotiation.cc:769] Sending connection context
0809 06:52:48.147028 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 06:52:48.147235 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 06:52:48.147570 18376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.133729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47554 (local address 127.10.205.125:42637)
0809 06:52:48.134383 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:48.134387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:48.134401 (+ 14us) server_negotiation.cc:407] Connection header received
0809 06:52:48.134451 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:48.134454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:48.134504 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:48.134585 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:48.135400 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.136636 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.138218 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.138696 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.138856 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.142746 (+ 3890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:48.142751 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:48.142755 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:48.142786 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:48.145358 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.145956 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.145959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.145962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.146092 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.146443 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.146446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.146448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.146706 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:48.146821 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:48.147113 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 06:52:48.147269 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":527,"thread_start_us":394,"threads_started":1}
I20260809 06:52:48.148676 18365 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:52:48 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258368, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.124@KRBTEST.COM for oryx/127.10.205.124@KRBTEST.COM
I20260809 06:52:48.161482 18370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.149403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:34223 (local address 127.0.0.1:34234)
0809 06:52:48.149643 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:48.149657 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:48.149738 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:48.149984 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:48.149987 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:48.150313 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:48.150449 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.150457 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.151330 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.151334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.152195 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.152205 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.152907 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.152911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.153052 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.153656 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:48.153670 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:48.155864 (+ 2194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:48.159101 (+ 3237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.159106 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.159110 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.159602 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.159989 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.159993 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.159995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.160146 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.160699 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:48.160702 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:48.160847 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 06:52:48.160959 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 06:52:48.161160 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166}
I20260809 06:52:48.161574 18368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.149402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34234 (local address 127.10.205.124:34223)
0809 06:52:48.149558 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:48.149562 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:48.149713 (+ 151us) server_negotiation.cc:407] Connection header received
0809 06:52:48.149819 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:48.149822 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:48.149876 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:48.149948 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:48.150560 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.151220 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.152387 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.152771 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.152867 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.156031 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:48.156035 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:48.156039 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:48.156073 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:48.158960 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.159727 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.159731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.159733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.159891 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.160238 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.160241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.160243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.160596 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:48.160707 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:48.161043 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 06:52:48.161314 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":59}
I20260809 06:52:48.167022 18365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: Bootstrap starting.
I20260809 06:52:48.170411 18365 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:48.171523 18365 log.cc:824] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:48.174351 18365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: No bootstrap required, opened a new log
I20260809 06:52:48.182191 18365 raft_consensus.cc:348] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } }
I20260809 06:52:48.182571 18365 raft_consensus.cc:374] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:48.182703 18365 raft_consensus.cc:729] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290370fbd1d2488aa16e25d514a89532, State: Initialized, Role: FOLLOWER
I20260809 06:52:48.183374 18365 consensus_queue.cc:260] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } }
I20260809 06:52:48.184376 18378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } } }
I20260809 06:52:48.184737 18378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:52:48.185441 18365 sys_catalog.cc:564] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 06:52:48.195269 18389 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:52:48.195452 18389 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:52:48.200037 18205 master_runner.cc:428] Detected that this master 290370fbd1d2488aa16e25d514a89532 is joining an existing cluster
I20260809 06:52:48.200201 18205 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.205.124:34223
I20260809 06:52:48.227648 18368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.206547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34240 (local address 127.10.205.124:34223)
0809 06:52:48.206787 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:48.206793 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:48.207999 (+ 1206us) server_negotiation.cc:407] Connection header received
0809 06:52:48.208184 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:48.208188 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:48.208248 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:48.208342 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:48.210264 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.211417 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.213659 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.214432 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.214516 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.220275 (+ 5759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:48.220282 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:48.220287 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:48.220330 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:48.224024 (+ 3694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.224858 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.224864 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.224867 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.225009 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.225501 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.225506 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.225509 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.226279 (+ 770us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:48.226466 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:48.227011 (+ 545us) server_negotiation.cc:299] Negotiation successful
0809 06:52:48.227258 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":67}
I20260809 06:52:48.228634 18396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.206092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:34223 (local address 127.0.0.1:34240)
0809 06:52:48.207834 (+ 1742us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:48.207855 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:48.208076 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:48.208508 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:48.208514 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:48.209469 (+ 955us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:48.210137 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.210145 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.211638 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.211644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.213503 (+ 1859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.213511 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.214801 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.214807 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.215923 (+ 1116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.218666 (+ 2743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:48.218690 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:48.220049 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:48.224171 (+ 4122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.224176 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.224180 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.224724 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.225138 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.225143 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.225146 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.225367 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.226538 (+ 1171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:48.226543 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:48.226724 (+ 181us) client_negotiation.cc:769] Sending connection context
0809 06:52:48.227871 (+ 1147us) client_negotiation.cc:240] Negotiation successful
0809 06:52:48.228160 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1585,"mutex_wait_us":219,"spinlock_wait_cycles":35584,"thread_start_us":885,"threads_started":1}
I20260809 06:52:48.233780 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 17665
I20260809 06:52:48.236284 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.205998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:59158)
0809 06:52:48.207368 (+ 1370us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:48.207391 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:48.207788 (+ 397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:48.208457 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:48.208464 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:48.209469 (+ 1005us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:48.210103 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.210122 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.211586 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.211593 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.213495 (+ 1902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.213510 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.214775 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.214783 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.215041 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.216758 (+ 1717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:48.216785 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:48.219278 (+ 2493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:48.231944 (+ 12666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.231949 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.231953 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.233460 (+ 1507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.233987 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.233993 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.233997 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.234200 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.235058 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:48.235069 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:48.235290 (+ 221us) client_negotiation.cc:769] Sending connection context
0809 06:52:48.235454 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 06:52:48.235790 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1171,"mutex_wait_us":131,"spinlock_wait_cycles":896,"thread_start_us":1433,"threads_started":1}
I20260809 06:52:48.237429 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.205908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59158 (local address 127.10.205.126:45343)
0809 06:52:48.206147 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:48.206155 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:48.207646 (+ 1491us) server_negotiation.cc:407] Connection header received
0809 06:52:48.208002 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:48.208009 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:48.208118 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:48.208198 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:48.210300 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.211417 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.213690 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.214369 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.214504 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.219532 (+ 5028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:48.219542 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:48.219547 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:48.219598 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:48.231739 (+ 12141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.233628 (+ 1889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.233635 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.233639 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.233824 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.234367 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.234373 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.234377 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.234791 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:48.234976 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:48.236767 (+ 1791us) server_negotiation.cc:299] Negotiation successful
0809 06:52:48.237061 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:52:48.239530 18376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.207960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47562 (local address 127.10.205.125:42637)
0809 06:52:48.208121 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:48.208127 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:48.218585 (+ 10458us) server_negotiation.cc:407] Connection header received
0809 06:52:48.218865 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:48.218871 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:48.218954 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:48.219035 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:48.220677 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.221837 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.224230 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.224980 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.225093 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.227755 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:48.227762 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:48.227768 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:48.227828 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:48.231752 (+ 3924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.234876 (+ 3124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.234882 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.234884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.235079 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.235605 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.235613 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.235616 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.236036 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:48.236224 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:48.237127 (+ 903us) server_negotiation.cc:299] Negotiation successful
0809 06:52:48.237447 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 06:52:48.241725 18398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.208132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:42637 (local address 127.0.0.1:47562)
0809 06:52:48.218478 (+ 10346us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:48.218497 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:48.218689 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:48.219278 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:48.219286 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:48.220024 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:48.220488 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.220505 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.222024 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.222030 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.224042 (+ 2012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.224060 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.225450 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.225463 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.225682 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.226412 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:48.226443 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:48.227530 (+ 1087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:48.231944 (+ 4414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.231949 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.231953 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.234698 (+ 2745us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.235240 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.235249 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.235252 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.235469 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.236367 (+ 898us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:48.236373 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:48.236736 (+ 363us) client_negotiation.cc:769] Sending connection context
0809 06:52:48.239925 (+ 3189us) client_negotiation.cc:240] Negotiation successful
0809 06:52:48.240989 (+ 1064us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10186,"spinlock_wait_cycles":49920,"thread_start_us":9485,"threads_started":1}
Aug 09 06:52:48 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258365, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.126@KRBTEST.COM for oryx/127.10.205.124@KRBTEST.COM
Aug 09 06:52:48 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.205.65@KRBTEST.COM
I20260809 06:52:48.262045 18374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.244525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:34223 (local address 127.0.0.1:34254)
0809 06:52:48.244909 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:48.244929 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:48.245044 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:48.245680 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:48.245685 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:48.246185 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:48.246389 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.246403 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.248250 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.248290 (+ 40us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.249771 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.249787 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.250808 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.250814 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.251013 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.251822 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:48.251847 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:48.254613 (+ 2766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:48.259014 (+ 4401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.259020 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.259025 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.259645 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.260073 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.260078 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.260081 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.260318 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.261019 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:48.261025 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:48.261209 (+ 184us) client_negotiation.cc:769] Sending connection context
0809 06:52:48.261360 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 06:52:48.261655 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256}
I20260809 06:52:48.263244 18368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.244948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34254 (local address 127.10.205.124:34223)
0809 06:52:48.245175 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:48.245183 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:48.245207 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:52:48.245331 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:48.245339 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:48.245494 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:48.245634 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:48.246565 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.248084 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.249937 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.250634 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.250799 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.254809 (+ 4010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:48.254817 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:48.254821 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:48.254852 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:48.258817 (+ 3965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.259775 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.259781 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.259785 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.259939 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.260448 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.260453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.260457 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.260857 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:48.262473 (+ 1616us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:48.262629 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 06:52:48.262864 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 06:52:48.264999 17599 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.205.124:34223: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "290370fbd1d2488aa16e25d514a89532"
member_type: NON_VOTER
last_known_addr {
host: "127.10.205.124"
port: 34223
}
attrs {
promote: true
}
}
dest_uuid: "101ca3fbfe034a68b712a15edf416cc8"
cas_config_opid_index: 5
I20260809 06:52:48.266321 17599 consensus_queue.cc:237] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } }
I20260809 06:52:48.268448 18372 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 290370fbd1d2488aa16e25d514a89532 (127.10.205.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } } }
I20260809 06:52:48.272794 18399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.235639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57614 (local address 127.10.205.65:34113)
0809 06:52:48.250464 (+ 14825us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:48.250474 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:48.250505 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:52:48.250574 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:48.250583 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:48.250892 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:48.251066 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:48.252996 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.254864 (+ 1868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.256920 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.257685 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.257841 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.263172 (+ 5331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:48.263187 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:48.263202 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:48.263247 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:48.268161 (+ 4914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.269310 (+ 1149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.269320 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.269323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.269497 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.270021 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.270027 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.270031 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.270479 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:48.270794 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:48.272026 (+ 1232us) server_negotiation.cc:299] Negotiation successful
0809 06:52:48.272341 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14619,"thread_start_us":14443,"threads_started":1}
I20260809 06:52:48.272826 18254 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 LEARNER]: Refusing update from remote peer 101ca3fbfe034a68b712a15edf416cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 06:52:48.273569 18339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:48.276901 18339 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 FOLLOWER]: Refusing update from remote peer 101ca3fbfe034a68b712a15edf416cc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 06:52:48.278625 18372 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.205.124:34223
I20260809 06:52:48.278848 18403 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 06:52:48.279316 18205 master.cc:537] Master@127.10.205.124:34223 shutting down...
I20260809 06:52:48.280481 18403 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:48.284477 17798 generic_service.cc:196] Checking for leaks (request via RPC)
W20260809 06:52:48.293459 17583 consensus_peers.cc:487] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 -> Peer 290370fbd1d2488aa16e25d514a89532 (127.10.205.124:34223): Couldn't send request to peer 290370fbd1d2488aa16e25d514a89532. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 06:52:48.292510 18401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } } }
I20260809 06:52:48.293743 18401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:48.295873 18254 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 290370fbd1d2488aa16e25d514a89532 (127.10.205.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } } }
I20260809 06:52:48.297560 18205 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:48.298136 18205 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:48.298462 18205 tablet_replica.cc:330] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: stopping tablet replica
I20260809 06:52:48.301093 18283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: NON_VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: true } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } } }
I20260809 06:52:48.301393 18283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: This master's current role is: LEARNER
I20260809 06:52:48.302783 18401 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8: attempting to promote NON_VOTER 1c5c422506294437bf14595e48292673 to VOTER
I20260809 06:52:48.303642 18401 consensus_queue.cc:237] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } }
I20260809 06:52:48.306070 18374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.305397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:34223 (local address 127.0.0.1:34270)
0809 06:52:48.305724 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:48.305872 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208}
I20260809 06:52:48.306764 18254 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 LEARNER]: Refusing update from remote peer 101ca3fbfe034a68b712a15edf416cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 06:52:48.307350 18400 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 06:52:48.307708 18374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.306933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:34223 (local address 127.0.0.1:34272)
0809 06:52:48.307351 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:48.307467 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:34223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228}
W20260809 06:52:48.308048 17583 consensus_peers.cc:487] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 -> Peer 290370fbd1d2488aa16e25d514a89532 (127.10.205.124:34223): Couldn't send request to peer 290370fbd1d2488aa16e25d514a89532. Status: Network error: Client connection negotiation failed: client connection to 127.10.205.124:34223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 06:52:48.309389 18205 master.cc:552] Master@127.10.205.124:34223 shutdown complete.
I20260809 06:52:48.309556 18205 master_runner.cc:305] Clearing existing system tablet
I20260809 06:52:48.310117 18205 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:48.310322 18205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:48.310427 18400 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 1c5c422506294437bf14595e48292673 (127.10.205.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } } }
I20260809 06:52:48.312933 18253 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 1c5c422506294437bf14595e48292673 (127.10.205.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } } }
I20260809 06:52:48.319234 18283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } } }
I20260809 06:52:48.319509 18283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:52:48.320896 18372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } } }
I20260809 06:52:48.321177 18372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:48.322394 18401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } } }
I20260809 06:52:48.322782 18401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:48.323515 18205 fs_manager.cc:709] Time spent opening directory manager: real 0.012s user 0.006s sys 0.003s
I20260809 06:52:48.325519 18409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:48.325891 18205 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:48.326371 18205 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:52:48.326534 18205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/wal
uuid: "290370fbd1d2488aa16e25d514a89532"
format_stamp: "Formatted at 2026-08-09 06:52:48 on dist-test-slave-0b58"
server_key: "a9775abc487890cfc71000b87f690789"
server_key_iv: "866429d15cebf3a625158cff186fd5da"
server_key_version: "encryptionkey@0"
I20260809 06:52:48.331840 18205 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:48.339128 18205 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 06:52:48.339336 18205 log.cc:1196] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 06:52:48.339824 18205 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: Deleting consensus metadata
I20260809 06:52:48.340107 18205 master_runner.cc:315] Copying system tablet from 127.10.205.126:45343
I20260809 06:52:48.342846 18205 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: tablet copy: Beginning tablet copy session from remote peer at address 127.10.205.126:45343
I20260809 06:52:48.359859 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.343777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59170 (local address 127.10.205.126:45343)
0809 06:52:48.344027 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:48.344034 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:48.345062 (+ 1028us) server_negotiation.cc:407] Connection header received
0809 06:52:48.345263 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:48.345269 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:48.345356 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:48.345466 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:48.346539 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.347695 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.349626 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.350346 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.350466 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.352930 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:48.352937 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:48.352942 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:48.352981 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:48.356625 (+ 3644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.357416 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.357422 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.357426 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.357579 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:48.358039 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:48.358044 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:48.358048 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:48.358470 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:48.358611 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:48.359198 (+ 587us) server_negotiation.cc:299] Negotiation successful
0809 06:52:48.359426 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260809 06:52:48.359992 18415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.343688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:59170)
0809 06:52:48.344918 (+ 1230us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:48.344950 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:48.345112 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:48.345541 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:48.345546 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:48.346095 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:48.346368 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.346381 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.347882 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.347888 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.349453 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.349468 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.350510 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.350520 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.350696 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.351453 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:48.351478 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:48.352679 (+ 1201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:48.356764 (+ 4085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.356770 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.356775 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.357286 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.357700 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:48.357710 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:48.357714 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:48.357907 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:48.358590 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:48.358596 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:48.358887 (+ 291us) client_negotiation.cc:769] Sending connection context
0809 06:52:48.359053 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 06:52:48.359391 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1090,"thread_start_us":988,"threads_started":1}
I20260809 06:52:48.360926 17620 tablet_copy_service.cc:140] P 101ca3fbfe034a68b712a15edf416cc8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 290370fbd1d2488aa16e25d514a89532 ({username='oryx', principal='oryx/127.10.205.124@KRBTEST.COM'} at 127.0.0.1:59170)
I20260809 06:52:48.361112 17620 tablet_copy_service.cc:161] P 101ca3fbfe034a68b712a15edf416cc8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 290370fbd1d2488aa16e25d514a89532 at {username='oryx', principal='oryx/127.10.205.124@KRBTEST.COM'} at 127.0.0.1:59170: session id = 290370fbd1d2488aa16e25d514a89532-00000000000000000000000000000000
I20260809 06:52:48.364889 17620 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 06:52:48.373859 18205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 06:52:48.381353 18205 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: tablet copy: Starting download of 0 data blocks...
I20260809 06:52:48.381692 18205 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: tablet copy: Starting download of 1 WAL segments...
I20260809 06:52:48.384443 18205 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 06:52:48.389209 17620 tablet_copy_service.cc:342] P 101ca3fbfe034a68b712a15edf416cc8: Request end of tablet copy session 290370fbd1d2488aa16e25d514a89532-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.205.124@KRBTEST.COM'} at 127.0.0.1:59170
I20260809 06:52:48.389367 17620 tablet_copy_service.cc:433] P 101ca3fbfe034a68b712a15edf416cc8: ending tablet copy session 290370fbd1d2488aa16e25d514a89532-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 290370fbd1d2488aa16e25d514a89532
I20260809 06:52:48.402487 18205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:48.405225 18416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:48.405746 18417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:48.416396 18205 server_base.cc:1034] running on GCE node
W20260809 06:52:48.416249 18419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:48.417042 18205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:48.417737 18205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:48.418962 18205 hybrid_clock.cc:648] HybridClock initialized: now 1786258368418906 us; error 38 us; skew 500 ppm
I20260809 06:52:48.419206 18205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:48 dist-test-slave-0b58 krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258368, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:48.421492 18205 init.cc:377] Logged in from keytab as oryx/127.10.205.124@KRBTEST.COM (short username oryx)
I20260809 06:52:48.427887 18205 webserver.cc:460] Webserver started at http://127.10.205.124:36593/ using document root <none> and password file <none>
I20260809 06:52:48.428277 18205 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:48.428395 18205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:48.431910 18205 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 06:52:48.434135 18426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:48.434577 18205 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 06:52:48.434738 18205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/wal
uuid: "290370fbd1d2488aa16e25d514a89532"
format_stamp: "Formatted at 2026-08-09 06:52:48 on dist-test-slave-0b58"
server_key: "a9775abc487890cfc71000b87f690789"
server_key_iv: "866429d15cebf3a625158cff186fd5da"
server_key_version: "encryptionkey@0"
I20260809 06:52:48.434980 18205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:48.438869 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 17665
I20260809 06:52:48.460582 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:34113
--local_ip_for_outbound_sockets=127.10.205.65
--tserver_master_addrs=127.10.205.126:45343
--webserver_port=33629
--webserver_interface=127.10.205.65
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab
--principal=oryx/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:41229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.205.126:45343,127.10.205.125:42637
--tserver_master_addrs=127.10.205.126:45343,127.10.205.125:42637,127.10.205.124:34223 with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:52:48.473482 18205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:48.477979 18205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:48.509003 18205 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.124:34223
I20260809 06:52:48.509093 18483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.124:34223 every 8 connection(s)
I20260809 06:52:48.510133 18205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
I20260809 06:52:48.515625 18484 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:52:48.519773 18484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: Bootstrap starting.
I20260809 06:52:48.541615 18484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:52:48.542210 18484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: Bootstrap complete.
I20260809 06:52:48.543462 18484 raft_consensus.cc:348] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } }
I20260809 06:52:48.543792 18484 raft_consensus.cc:729] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 290370fbd1d2488aa16e25d514a89532, State: Initialized, Role: LEARNER
I20260809 06:52:48.544086 18484 consensus_queue.cc:260] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } }
I20260809 06:52:48.545027 18487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } } }
I20260809 06:52:48.545353 18484 sys_catalog.cc:564] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:48.545572 18487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: This master's current role is: LEARNER
I20260809 06:52:48.554216 18499 catalog_manager.cc:1259] Loaded cluster ID: 644831ef554146cc8c7cace8637951b2
I20260809 06:52:48.554355 18499 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: loading cluster ID for follower catalog manager: success
I20260809 06:52:48.556905 18499 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: acquiring CA information for follower catalog manager: success
I20260809 06:52:48.558967 18499 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:52:48.730464 18374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.721957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:34223 (local address 127.0.0.1:34278)
0809 06:52:48.722235 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:48.722256 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:48.722393 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:48.723460 (+ 1067us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:48.723467 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:48.723511 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:48.723763 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.723777 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.725850 (+ 2073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.725856 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.727763 (+ 1907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:48.727781 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.729549 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.729554 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:48.729791 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.729837 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 06:52:48.729964 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 06:52:48.730129 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154}
I20260809 06:52:48.730952 18500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:48.722143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34278 (local address 127.10.205.124:34223)
0809 06:52:48.723022 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:48.723028 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:48.723054 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:52:48.723133 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:48.723139 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:48.723247 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:48.723390 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:48.723991 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.725686 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.727950 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:48.729349 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:48.729555 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:48.729748 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:48.730013 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 06:52:48.730184 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":511,"threads_started":1}
I20260809 06:52:48.732018 18455 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 06:52:48.732617 18487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 101ca3fbfe034a68b712a15edf416cc8. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } } }
I20260809 06:52:48.732940 18487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: This master's current role is: LEARNER
W20260809 06:52:48.878258 18432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:48.878670 18432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:48.878858 18432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:48.886818 18432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:48.886951 18432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:48.887161 18432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:52:48.897650 18432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:41229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab
--principal=oryx/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:34113
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=33629
--tserver_master_addrs=127.10.205.126:45343,127.10.205.125:42637,127.10.205.124:34223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:48.899260 18432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:48.900723 18432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:48.915068 18508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:48.915153 18506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:48.915110 18505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:48.916338 18432 server_base.cc:1034] running on GCE node
I20260809 06:52:48.917032 18432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:48.917994 18432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:48.919304 18432 hybrid_clock.cc:648] HybridClock initialized: now 1786258368919234 us; error 54 us; skew 500 ppm
I20260809 06:52:48.919685 18432 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:48 dist-test-slave-0b58 krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258368, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:48.923168 18432 init.cc:377] Logged in from keytab as oryx/127.10.205.65@KRBTEST.COM (short username oryx)
I20260809 06:52:48.924790 18432 webserver.cc:460] Webserver started at http://127.10.205.65:33629/ using document root <none> and password file <none>
I20260809 06:52:48.925534 18432 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:48.925706 18432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:48.931721 18432 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:52:48.934883 18515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:48.936327 18432 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:52:48.936547 18432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "d2118f5e30354ee5bfa22b07a088cf77"
format_stamp: "Formatted at 2026-08-09 06:52:45 on dist-test-slave-0b58"
server_key: "0bc4c79012404f1e1552a078eae55f12"
server_key_iv: "b37a155cca9f5e21233d7978c7c2af58"
server_key_version: "encryptionkey@0"
I20260809 06:52:48.937640 18432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:48.969277 18432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:48.973982 18432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:48.974355 18432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:48.975524 18432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:48.977075 18432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:48.977167 18432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:48.977249 18432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:48.977311 18432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:49.014664 18432 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:34113
I20260809 06:52:49.014760 18636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:34113 every 8 connection(s)
I20260809 06:52:49.016342 18432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:52:49.021889 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 18432
I20260809 06:52:49.022259 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 17811
Aug 09 06:52:49 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258368, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.125@KRBTEST.COM
Aug 09 06:52:49 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258368, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
Aug 09 06:52:49 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258368, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.124@KRBTEST.COM
Aug 09 06:52:49 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.205.66@KRBTEST.COM
I20260809 06:52:49.048359 18642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.019475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:45461 (local address 127.10.205.125:42637)
0809 06:52:49.020104 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:49.020110 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:49.021481 (+ 1371us) server_negotiation.cc:407] Connection header received
0809 06:52:49.025378 (+ 3897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:49.025383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:49.025481 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:49.025638 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:49.028424 (+ 2786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.029582 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.033145 (+ 3563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.033803 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.033893 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.040578 (+ 6685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:49.040585 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:49.040590 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:49.040637 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:49.044929 (+ 4292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.045771 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.045778 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.045783 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.045946 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.046455 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.046463 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.046469 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.046807 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:49.046931 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:49.047683 (+ 752us) server_negotiation.cc:299] Negotiation successful
0809 06:52:49.047948 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":390,"threads_started":1}
I20260809 06:52:49.048377 18646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.021961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:43661 (local address 127.10.205.126:45343)
0809 06:52:49.023630 (+ 1669us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:49.023637 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:49.023660 (+ 23us) server_negotiation.cc:407] Connection header received
0809 06:52:49.025275 (+ 1615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:49.025280 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:49.025374 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:49.025461 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:49.028412 (+ 2951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.029587 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.033104 (+ 3517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.033811 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.033930 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.039795 (+ 5865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:49.039800 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:49.039803 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:49.039841 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:49.044000 (+ 4159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.045252 (+ 1252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.045259 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.045262 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.045405 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.045963 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.045968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.045972 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.046428 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:49.046563 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:49.047684 (+ 1121us) server_negotiation.cc:299] Negotiation successful
0809 06:52:49.047948 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1517,"thread_start_us":1408,"threads_started":1}
I20260809 06:52:49.048417 18500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.019475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:41447 (local address 127.10.205.124:34223)
0809 06:52:49.019695 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:49.019705 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:49.023015 (+ 3310us) server_negotiation.cc:407] Connection header received
0809 06:52:49.025384 (+ 2369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:49.025389 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:49.025478 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:49.025598 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:49.028424 (+ 2826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.029666 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.033042 (+ 3376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.033736 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.033854 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.040036 (+ 6182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:49.040043 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:49.040048 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:49.040107 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:49.044123 (+ 4016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.045378 (+ 1255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.045384 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.045389 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.045580 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.046063 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.046069 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.046073 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.046635 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:49.046793 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:49.047720 (+ 927us) server_negotiation.cc:299] Negotiation successful
0809 06:52:49.048014 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 06:52:49.050725 18648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.023862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45060 (local address 127.10.205.66:41835)
0809 06:52:49.024583 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:49.024593 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:49.024622 (+ 29us) server_negotiation.cc:407] Connection header received
0809 06:52:49.024698 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:49.024707 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:49.024966 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:49.025136 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:49.027642 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.029782 (+ 2140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.031770 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.032719 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.032866 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.041689 (+ 8823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:49.041709 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:49.041728 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:49.041775 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:49.045961 (+ 4186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.046996 (+ 1035us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.047005 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.047008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.047194 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.047749 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.047754 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.047757 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.048212 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:49.048663 (+ 451us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:49.050002 (+ 1339us) server_negotiation.cc:299] Negotiation successful
0809 06:52:49.050272 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":303,"threads_started":1}
I20260809 06:52:49.050819 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.021820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.65:43661)
0809 06:52:49.022461 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:49.022482 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:49.024942 (+ 2460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:49.025998 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:49.026008 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:49.027015 (+ 1007us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:49.028184 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:49.028200 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.029807 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.029814 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:49.032858 (+ 3044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:49.032879 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.034294 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.034302 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:49.034707 (+ 405us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.035477 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:49.035520 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:49.039501 (+ 3981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:49.044233 (+ 4732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:49.044244 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:49.044284 (+ 40us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:49.045114 (+ 830us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:49.045552 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:49.045558 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:49.045567 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:49.045831 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:49.046679 (+ 848us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:49.046687 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:49.047164 (+ 477us) client_negotiation.cc:769] Sending connection context
0809 06:52:49.048628 (+ 1464us) client_negotiation.cc:240] Negotiation successful
0809 06:52:49.049243 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"mutex_wait_us":706,"spinlock_wait_cycles":38272,"thread_start_us":325,"threads_started":1}
I20260809 06:52:49.050884 18643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.020137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:34223 (local address 127.10.205.65:41447)
0809 06:52:49.022857 (+ 2720us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:49.022893 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:49.024957 (+ 2064us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:49.025996 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:49.026008 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:49.027107 (+ 1099us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:49.028164 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:49.028192 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.029820 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.029825 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:49.032867 (+ 3042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:49.032877 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.034241 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.034248 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:49.034715 (+ 467us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.035793 (+ 1078us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:49.035814 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:49.039790 (+ 3976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:49.044333 (+ 4543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:49.044338 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:49.044345 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:49.045221 (+ 876us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:49.045738 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:49.045742 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:49.045746 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:49.045925 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:49.046880 (+ 955us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:49.046888 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:49.047166 (+ 278us) client_negotiation.cc:769] Sending connection context
0809 06:52:49.048712 (+ 1546us) client_negotiation.cc:240] Negotiation successful
0809 06:52:49.049425 (+ 713us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"mutex_wait_us":857,"spinlock_wait_cycles":27136,"thread_start_us":421,"threads_started":1}
I20260809 06:52:49.051489 18644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.020137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:42637 (local address 127.10.205.65:45461)
0809 06:52:49.021269 (+ 1132us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:49.021329 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:49.024957 (+ 3628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:49.025996 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:49.026008 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:49.027107 (+ 1099us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:49.028169 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:49.028192 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.029820 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.029825 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:49.032849 (+ 3024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:49.032866 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.034241 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.034248 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:49.034716 (+ 468us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.035705 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:49.035745 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:49.040340 (+ 4595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:49.045110 (+ 4770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:49.045115 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:49.045119 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:49.045629 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:49.046094 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:49.046098 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:49.046101 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:49.046318 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:49.047007 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:49.047011 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:49.047164 (+ 153us) client_negotiation.cc:769] Sending connection context
0809 06:52:49.049112 (+ 1948us) client_negotiation.cc:240] Negotiation successful
0809 06:52:49.049585 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":874,"mutex_wait_us":744,"spinlock_wait_cycles":83200,"thread_start_us":455,"threads_started":1}
I20260809 06:52:49.052204 17943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:49.052667 18638 heartbeater.cc:347] Connected to a master server at 127.10.205.126:45343
I20260809 06:52:49.053048 18638 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:49.053215 18637 heartbeater.cc:347] Connected to a master server at 127.10.205.124:34223
I20260809 06:52:49.053347 18637 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:49.053471 18639 heartbeater.cc:347] Connected to a master server at 127.10.205.125:42637
I20260809 06:52:49.053653 18639 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:49.054256 18639 heartbeater.cc:511] Master 127.10.205.125:42637 requested a full tablet report, sending...
I20260809 06:52:49.054293 18637 heartbeater.cc:511] Master 127.10.205.124:34223 requested a full tablet report, sending...
I20260809 06:52:49.054425 18638 heartbeater.cc:511] Master 127.10.205.126:45343 requested a full tablet report, sending...
I20260809 06:52:49.056015 17599 ts_manager.cc:194] Re-registered known tserver with Master: d2118f5e30354ee5bfa22b07a088cf77 (127.10.205.65:34113)
I20260809 06:52:49.057101 18445 ts_manager.cc:194] Registered new tserver with Master: d2118f5e30354ee5bfa22b07a088cf77 (127.10.205.65:34113)
I20260809 06:52:49.057248 17599 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:43661
I20260809 06:52:49.057461 18244 ts_manager.cc:194] Registered new tserver with Master: d2118f5e30354ee5bfa22b07a088cf77 (127.10.205.65:34113)
I20260809 06:52:49.144922 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 17811
I20260809 06:52:49.166035 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:41835
--local_ip_for_outbound_sockets=127.10.205.66
--tserver_master_addrs=127.10.205.126:45343
--webserver_port=45067
--webserver_interface=127.10.205.66
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab
--principal=oryx/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:41229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.205.126:45343,127.10.205.125:42637
--tserver_master_addrs=127.10.205.126:45343,127.10.205.125:42637,127.10.205.124:34223 with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:52:49.218606 18401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: NON_VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: true } } }
I20260809 06:52:49.219074 18401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:49.220531 18652 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8: attempting to promote NON_VOTER 290370fbd1d2488aa16e25d514a89532 to VOTER
I20260809 06:52:49.221439 18652 consensus_queue.cc:237] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } }
I20260809 06:52:49.224241 18253 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 FOLLOWER]: Refusing update from remote peer 101ca3fbfe034a68b712a15edf416cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 06:52:49.225670 18401 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 06:52:49.228133 18455 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 LEARNER]: Refusing update from remote peer 101ca3fbfe034a68b712a15edf416cc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 06:52:49.229504 18652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 06:52:49.231177 18253 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 290370fbd1d2488aa16e25d514a89532 (127.10.205.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } } }
I20260809 06:52:49.233043 18455 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 290370fbd1d2488aa16e25d514a89532 (127.10.205.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } } }
I20260809 06:52:49.236231 18655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } } }
I20260809 06:52:49.236699 18655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:52:49.238392 18651 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 290370fbd1d2488aa16e25d514a89532 (127.10.205.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } } }
I20260809 06:52:49.241595 18656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } } }
I20260809 06:52:49.242045 18656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:52:49.244566 18652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } } }
I20260809 06:52:49.244623 18401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } } }
I20260809 06:52:49.244997 18652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:49.245018 18401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:49.245380 18652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "101ca3fbfe034a68b712a15edf416cc8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } } }
I20260809 06:52:49.245699 18652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8 [sys.catalog]: This master's current role is: LEADER
W20260809 06:52:49.523716 18650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:49.524042 18650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:49.524205 18650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:49.531759 18650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:49.531931 18650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:49.532150 18650 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:52:49.542716 18650 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:41229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab
--principal=oryx/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:41835
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=45067
--tserver_master_addrs=127.10.205.126:45343,127.10.205.125:42637,127.10.205.124:34223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:49.544137 18650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:49.545619 18650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:49.560668 18665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:49.560631 18663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:49.560724 18662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:49.565840 18650 server_base.cc:1034] running on GCE node
I20260809 06:52:49.566607 18650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:49.567665 18650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:49.568878 18650 hybrid_clock.cc:648] HybridClock initialized: now 1786258369568834 us; error 31 us; skew 500 ppm
I20260809 06:52:49.569218 18650 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:49 dist-test-slave-0b58 krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258369, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:49.572664 18650 init.cc:377] Logged in from keytab as oryx/127.10.205.66@KRBTEST.COM (short username oryx)
I20260809 06:52:49.574288 18650 webserver.cc:460] Webserver started at http://127.10.205.66:45067/ using document root <none> and password file <none>
I20260809 06:52:49.575058 18650 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:49.575248 18650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:49.581101 18650 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 06:52:49.583946 18672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:49.585387 18650 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:52:49.585577 18650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "82dbd80f566f4508a0cfc45c590dac21"
format_stamp: "Formatted at 2026-08-09 06:52:46 on dist-test-slave-0b58"
server_key: "69455233922272fb7252061f06bd2ccb"
server_key_iv: "66c7e42f70baca073fe1e707b651223d"
server_key_version: "encryptionkey@0"
I20260809 06:52:49.586647 18650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:49.601418 18650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:49.605535 18650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:49.605855 18650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:49.606873 18650 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:49.608289 18650 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:49.608413 18650 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:49.608549 18650 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:49.608644 18650 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:49.643524 18650 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:41835
I20260809 06:52:49.643612 18793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:41835 every 8 connection(s)
I20260809 06:52:49.645196 18650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:52:49.654870 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 18650
I20260809 06:52:49.655222 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 17954
Aug 09 06:52:49 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.205.67@KRBTEST.COM
Aug 09 06:52:49 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258369, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.124@KRBTEST.COM
Aug 09 06:52:49 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258369, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.125@KRBTEST.COM
Aug 09 06:52:49 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258369, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:49.693607 18803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.657101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52742 (local address 127.10.205.67:37399)
0809 06:52:49.667397 (+ 10296us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:49.667407 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:49.669299 (+ 1892us) server_negotiation.cc:407] Connection header received
0809 06:52:49.669384 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:49.669393 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:49.669681 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:49.669856 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:49.672439 (+ 2583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.674112 (+ 1673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.676087 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.676979 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.677098 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.685265 (+ 8167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:49.685284 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:49.685302 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:49.685346 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:49.689527 (+ 4181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.690530 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.690540 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.690543 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.690751 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.691281 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.691286 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.691290 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.691772 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:49.692093 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:49.692823 (+ 730us) server_negotiation.cc:299] Negotiation successful
0809 06:52:49.693107 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10098,"thread_start_us":9924,"threads_started":1}
I20260809 06:52:49.695027 18087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:49.696568 18801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.649013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:34223 (local address 127.10.205.66:36509)
0809 06:52:49.668135 (+ 19122us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:49.668226 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:49.672002 (+ 3776us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:49.673482 (+ 1480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:49.673495 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:49.674415 (+ 920us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:49.675362 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:49.675391 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.677055 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.677060 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:49.679440 (+ 2380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:49.679458 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.680888 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.680896 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:49.681169 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.682709 (+ 1540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:49.682738 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:49.685778 (+ 3040us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:49.691571 (+ 5793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:49.691578 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:49.691617 (+ 39us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:49.692313 (+ 696us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:49.692811 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:49.692816 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:49.692820 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:49.693132 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:49.693966 (+ 834us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:49.693974 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:49.694491 (+ 517us) client_negotiation.cc:769] Sending connection context
0809 06:52:49.694818 (+ 327us) client_negotiation.cc:240] Negotiation successful
0809 06:52:49.695397 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18801,"mutex_wait_us":42,"spinlock_wait_cycles":76032,"thread_start_us":19065,"threads_started":1}
I20260809 06:52:49.697146 18799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.648253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:36509 (local address 127.10.205.124:34223)
0809 06:52:49.665446 (+ 17193us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:49.665456 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:49.669094 (+ 3638us) server_negotiation.cc:407] Connection header received
0809 06:52:49.672437 (+ 3343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:49.672443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:49.672538 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:49.672802 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:49.675650 (+ 2848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.676806 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.679623 (+ 2817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.680360 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.680508 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.686030 (+ 5522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:49.686039 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:49.686045 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:49.686104 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:49.691381 (+ 5277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.692481 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.692487 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.692491 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.692649 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.693298 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.693305 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.693308 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.693726 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:49.693873 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:49.696497 (+ 2624us) server_negotiation.cc:299] Negotiation successful
0809 06:52:49.696752 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17024,"thread_start_us":16794,"threads_started":1}
I20260809 06:52:49.698413 18794 heartbeater.cc:347] Connected to a master server at 127.10.205.124:34223
I20260809 06:52:49.698750 18794 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:49.699704 18794 heartbeater.cc:511] Master 127.10.205.124:34223 requested a full tablet report, sending...
I20260809 06:52:49.701442 18800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.649013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.66:60229)
0809 06:52:49.673141 (+ 24128us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:49.673179 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:49.673648 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:49.679943 (+ 6295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:49.679948 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:49.680533 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:49.681607 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:49.681625 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.682878 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.682884 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:49.684766 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:49.684793 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.686088 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.686097 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:49.686361 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.686944 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:49.686969 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:49.690592 (+ 3623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:49.696948 (+ 6356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:49.696957 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:49.696963 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:49.697662 (+ 699us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:49.698798 (+ 1136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:49.698806 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:49.698812 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:49.699013 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:49.699973 (+ 960us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:49.699980 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:49.700181 (+ 201us) client_negotiation.cc:769] Sending connection context
0809 06:52:49.700402 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 06:52:49.700816 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11156,"mutex_wait_us":3,"thread_start_us":11399,"threads_started":1}
I20260809 06:52:49.701658 18445 ts_manager.cc:194] Registered new tserver with Master: 82dbd80f566f4508a0cfc45c590dac21 (127.10.205.66:41835)
I20260809 06:52:49.702219 18798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.648195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:60229 (local address 127.10.205.126:45343)
0809 06:52:49.679438 (+ 31243us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:49.679442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:49.679458 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:52:49.679508 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:49.679511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:49.679636 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:49.679759 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:49.681799 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.682690 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.684976 (+ 2286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.685693 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.685819 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.690864 (+ 5045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:49.690870 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:49.690874 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:49.690942 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:49.695083 (+ 4141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.697975 (+ 2892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.697981 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.697984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.698158 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.699166 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.699171 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.699174 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.699559 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:49.699730 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:49.701042 (+ 1312us) server_negotiation.cc:299] Negotiation successful
0809 06:52:49.701303 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31127,"thread_start_us":31017,"threads_started":1}
I20260809 06:52:49.703282 18795 heartbeater.cc:347] Connected to a master server at 127.10.205.126:45343
I20260809 06:52:49.703430 18795 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:49.704180 18795 heartbeater.cc:511] Master 127.10.205.126:45343 requested a full tablet report, sending...
I20260809 06:52:49.705184 18804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.662271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:53229 (local address 127.10.205.125:42637)
0809 06:52:49.677254 (+ 14983us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:49.677265 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:49.677292 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:52:49.677371 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:49.677378 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:49.677515 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:49.677653 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:49.680196 (+ 2543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.681528 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.683522 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.684278 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.684444 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.689164 (+ 4720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:49.689172 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:49.689177 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:49.689240 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:49.696793 (+ 7553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.699259 (+ 2466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.699269 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.699275 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.699469 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:49.700388 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:49.700393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:49.700398 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:49.700800 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:49.701970 (+ 1170us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:49.704559 (+ 2589us) server_negotiation.cc:299] Negotiation successful
0809 06:52:49.704853 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14781,"thread_start_us":15511,"threads_started":1}
I20260809 06:52:49.705521 17599 ts_manager.cc:194] Re-registered known tserver with Master: 82dbd80f566f4508a0cfc45c590dac21 (127.10.205.66:41835)
I20260809 06:52:49.707100 17599 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:60229
I20260809 06:52:49.708031 18805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:49.668320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:42637 (local address 127.10.205.66:53229)
0809 06:52:49.676338 (+ 8018us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:49.676367 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:49.676507 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:49.678012 (+ 1505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:49.678020 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:49.678884 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:49.679983 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:49.679995 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.681711 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.681718 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:49.683334 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:49.683350 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:49.684491 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:49.684497 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:49.684735 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:49.686104 (+ 1369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:49.686141 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:49.688917 (+ 2776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:49.697897 (+ 8980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:49.697905 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:49.697911 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:49.698663 (+ 752us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:49.699634 (+ 971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:49.699642 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:49.699648 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:49.699833 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:49.701964 (+ 2131us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:49.701972 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:49.704185 (+ 2213us) client_negotiation.cc:769] Sending connection context
0809 06:52:49.704436 (+ 251us) client_negotiation.cc:240] Negotiation successful
0809 06:52:49.704841 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7170,"mutex_wait_us":54,"thread_start_us":7228,"threads_started":1}
I20260809 06:52:49.709061 18796 heartbeater.cc:347] Connected to a master server at 127.10.205.125:42637
I20260809 06:52:49.709196 18796 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:49.709800 18796 heartbeater.cc:511] Master 127.10.205.125:42637 requested a full tablet report, sending...
I20260809 06:52:49.711195 18244 ts_manager.cc:194] Registered new tserver with Master: 82dbd80f566f4508a0cfc45c590dac21 (127.10.205.66:41835)
I20260809 06:52:49.794368 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 17954
I20260809 06:52:49.813401 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:37399
--local_ip_for_outbound_sockets=127.10.205.67
--tserver_master_addrs=127.10.205.126:45343
--webserver_port=38577
--webserver_interface=127.10.205.67
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab
--principal=oryx/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:41229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.205.126:45343,127.10.205.125:42637
--tserver_master_addrs=127.10.205.126:45343,127.10.205.125:42637,127.10.205.124:34223 with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:52:50.060876 18638 heartbeater.cc:503] Master 127.10.205.126:45343 was elected leader, sending a full tablet report...
W20260809 06:52:50.159935 18807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:50.160267 18807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:50.160476 18807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:50.168399 18807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:50.168547 18807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:50.168752 18807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:52:50.179316 18807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:41229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab
--principal=oryx/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:37399
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=38577
--tserver_master_addrs=127.10.205.126:45343,127.10.205.125:42637,127.10.205.124:34223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:50.180850 18807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:50.182273 18807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:50.196341 18815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:50.196295 18817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:50.196902 18813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:50.201999 18807 server_base.cc:1034] running on GCE node
I20260809 06:52:50.202754 18807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:50.203941 18807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:50.205188 18807 hybrid_clock.cc:648] HybridClock initialized: now 1786258370205143 us; error 60 us; skew 500 ppm
I20260809 06:52:50.205588 18807 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:50 dist-test-slave-0b58 krb5kdc[17552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258370, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:50.208923 18807 init.cc:377] Logged in from keytab as oryx/127.10.205.67@KRBTEST.COM (short username oryx)
I20260809 06:52:50.210518 18807 webserver.cc:460] Webserver started at http://127.10.205.67:38577/ using document root <none> and password file <none>
I20260809 06:52:50.211297 18807 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:50.211485 18807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:50.217386 18807 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 06:52:50.220158 18824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:50.221571 18807 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:52:50.221745 18807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "0cdb3675201d49ce8963d7c62d33497a"
format_stamp: "Formatted at 2026-08-09 06:52:46 on dist-test-slave-0b58"
server_key: "8ace1bd880d3870ae46db5275df503c0"
server_key_iv: "d7a70dd4e39ebf2ff050951bcb54ccca"
server_key_version: "encryptionkey@0"
I20260809 06:52:50.223034 18807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:50.250533 18807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:50.255007 18807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:50.255311 18807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:50.256383 18807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:52:50.257745 18807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:50.257886 18807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:50.258035 18807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:50.258141 18807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:50.293254 18807 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:37399
I20260809 06:52:50.293356 18945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:37399 every 8 connection(s)
I20260809 06:52:50.294744 18807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:52:50.301196 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 18807
Aug 09 06:52:50 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258370, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
Aug 09 06:52:50 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258370, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.124@KRBTEST.COM
I20260809 06:52:50.336606 18950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.297697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:53919 (local address 127.10.205.124:34223)
0809 06:52:50.313025 (+ 15328us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.313034 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.315123 (+ 2089us) server_negotiation.cc:407] Connection header received
0809 06:52:50.316216 (+ 1093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.316225 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.316368 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.316470 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:50.318908 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.319966 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.322472 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.322974 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.323052 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.328840 (+ 5788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:50.328845 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:50.328848 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:50.328883 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:50.332812 (+ 3929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.333832 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.333838 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.333842 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.334005 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.334500 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.334508 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.334512 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.334948 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:50.335100 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.335942 (+ 842us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.336197 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15152,"thread_start_us":15339,"threads_started":1}
I20260809 06:52:50.337901 18953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.298374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:34223 (local address 127.10.205.67:53919)
0809 06:52:50.314957 (+ 16583us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:50.314990 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:50.315276 (+ 286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:50.316756 (+ 1480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:50.316763 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:50.318047 (+ 1284us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:50.318701 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.318726 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.320145 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.320150 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.322279 (+ 2129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.322298 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.323332 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.323336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.323525 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.325413 (+ 1888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:50.325436 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:50.328615 (+ 3179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:50.332996 (+ 4381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:50.333006 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:50.333025 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:50.333682 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:50.334145 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:50.334151 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:50.334155 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:50.334395 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:50.335072 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:50.335080 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:50.335550 (+ 470us) client_negotiation.cc:769] Sending connection context
0809 06:52:50.335848 (+ 298us) client_negotiation.cc:240] Negotiation successful
0809 06:52:50.336441 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16362,"mutex_wait_us":32,"spinlock_wait_cycles":100736,"thread_start_us":13259,"threads_started":1}
I20260809 06:52:50.340099 18954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.298374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.67:33333)
0809 06:52:50.309924 (+ 11550us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:50.310011 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:50.315261 (+ 5250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:50.316187 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:50.316204 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:50.317429 (+ 1225us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:50.319064 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.319077 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.320877 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.320882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.322500 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.322512 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.323837 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.323847 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.324017 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.324638 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:50.324667 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:50.327970 (+ 3303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:50.333839 (+ 5869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:50.333844 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:50.333847 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:50.334326 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:50.335151 (+ 825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:50.335155 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:50.335158 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:50.335351 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:50.339062 (+ 3711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:50.339067 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:50.339228 (+ 161us) client_negotiation.cc:769] Sending connection context
0809 06:52:50.339374 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 06:52:50.339685 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11054,"thread_start_us":15996,"threads_started":1}
I20260809 06:52:50.340102 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.297698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:33333 (local address 127.10.205.126:45343)
0809 06:52:50.313875 (+ 16177us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.313884 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.313915 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:52:50.315673 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.315683 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.315795 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.315929 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:50.319236 (+ 3307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.320693 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.322637 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.323606 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.323770 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.328248 (+ 4478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:50.328284 (+ 36us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:50.328292 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:50.328360 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:50.333456 (+ 5096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.334536 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.334541 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.334544 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.334702 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.338634 (+ 3932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.338638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.338640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.338931 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:50.339103 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.339487 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.339731 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16003,"thread_start_us":15897,"threads_started":1}
I20260809 06:52:50.341867 18947 heartbeater.cc:347] Connected to a master server at 127.10.205.126:45343
I20260809 06:52:50.342207 18947 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:50.343039 18947 heartbeater.cc:511] Master 127.10.205.126:45343 requested a full tablet report, sending...
I20260809 06:52:50.344659 17599 ts_manager.cc:194] Re-registered known tserver with Master: 0cdb3675201d49ce8963d7c62d33497a (127.10.205.67:37399)
I20260809 06:52:50.346181 18946 heartbeater.cc:347] Connected to a master server at 127.10.205.124:34223
I20260809 06:52:50.346279 17599 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:33333
I20260809 06:52:50.346376 18946 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:50.346920 18946 heartbeater.cc:511] Master 127.10.205.124:34223 requested a full tablet report, sending...
I20260809 06:52:50.348340 18445 ts_manager.cc:194] Registered new tserver with Master: 0cdb3675201d49ce8963d7c62d33497a (127.10.205.67:37399)
Aug 09 06:52:50 dist-test-slave-0b58 krb5kdc[17552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258370, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.125@KRBTEST.COM
I20260809 06:52:50.358279 18959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.316062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:42637 (local address 127.10.205.67:49917)
0809 06:52:50.318855 (+ 2793us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:50.318881 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:50.319030 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:50.320945 (+ 1915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:50.320952 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:50.321835 (+ 883us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:50.322386 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.322402 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.325303 (+ 2901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.325309 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.330378 (+ 5069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.330400 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.344447 (+ 14047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.344454 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.344673 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.345363 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:50.345386 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:50.349229 (+ 3843us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:50.354153 (+ 4924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:50.354161 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:50.354168 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:50.354893 (+ 725us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:50.355690 (+ 797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:50.355695 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:50.355698 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:50.355905 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:50.356997 (+ 1092us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:50.357006 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:50.357221 (+ 215us) client_negotiation.cc:769] Sending connection context
0809 06:52:50.357415 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 06:52:50.357803 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2625,"thread_start_us":2432,"threads_started":1}
I20260809 06:52:50.359290 18958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.315193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:49917 (local address 127.10.205.125:42637)
0809 06:52:50.319400 (+ 4207us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.319406 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.319424 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:52:50.319476 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.319481 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.319549 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.319644 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:50.323987 (+ 4343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.325127 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.330761 (+ 5634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.331540 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.331687 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.349549 (+ 17862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:50.349556 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:50.349561 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:50.349611 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:50.353563 (+ 3952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.355366 (+ 1803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.355372 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.355381 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.355573 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.356052 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.356058 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.356061 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.356498 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:50.356979 (+ 481us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.358619 (+ 1640us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.358889 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4081,"thread_start_us":643,"threads_started":1}
I20260809 06:52:50.360219 18948 heartbeater.cc:347] Connected to a master server at 127.10.205.125:42637
I20260809 06:52:50.360406 18948 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:50.360909 18948 heartbeater.cc:511] Master 127.10.205.125:42637 requested a full tablet report, sending...
I20260809 06:52:50.362152 18244 ts_manager.cc:194] Registered new tserver with Master: 0cdb3675201d49ce8963d7c62d33497a (127.10.205.67:37399)
I20260809 06:52:50.366986 18962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.326519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59182 (local address 127.10.205.126:45343)
0809 06:52:50.327413 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.327419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.347216 (+ 19797us) server_negotiation.cc:407] Connection header received
0809 06:52:50.347832 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.347837 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.347935 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.348016 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:50.351724 (+ 3708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.353120 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.355031 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.355683 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.355767 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.359832 (+ 4065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:50.359839 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:50.359844 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:50.359886 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:50.363481 (+ 3595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.364373 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.364378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.364382 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.364532 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.365071 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.365080 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.365084 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.365453 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:50.365697 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.366209 (+ 512us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.366469 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":557,"threads_started":1}
I20260809 06:52:50.374450 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.350277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47574 (local address 127.10.205.125:42637)
0809 06:52:50.356091 (+ 5814us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.356098 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.356121 (+ 23us) server_negotiation.cc:407] Connection header received
0809 06:52:50.356176 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.356183 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.356284 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.356387 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:50.360338 (+ 3951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.361415 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.363275 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.364061 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.364188 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.367600 (+ 3412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:50.367605 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:50.367608 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:50.367637 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:50.371350 (+ 3713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.372131 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.372136 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.372139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.372331 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.372816 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.372822 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.372826 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.373208 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:50.373470 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.373794 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.374021 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5261,"thread_start_us":5976,"threads_started":1}
I20260809 06:52:50.375914 18950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.332083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34290 (local address 127.10.205.124:34223)
0809 06:52:50.336849 (+ 4766us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.336854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.351369 (+ 14515us) server_negotiation.cc:407] Connection header received
0809 06:52:50.355291 (+ 3922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.355310 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.355423 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.355526 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:50.358913 (+ 3387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.360820 (+ 1907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.363157 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.363694 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.363848 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.368737 (+ 4889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:50.368743 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:50.368754 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:50.368790 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:50.372244 (+ 3454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.373031 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.373036 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.373039 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.373192 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.373653 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.373662 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.373666 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.374019 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:50.374270 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.375418 (+ 1148us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.375660 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4661,"thread_start_us":13131,"threads_started":1}
I20260809 06:52:50.371987 17599 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59182:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:52:50.380693 17599 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:50.419013 18980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.400417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:41835 (local address 127.0.0.1:45064)
0809 06:52:50.401437 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:50.401458 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:50.401583 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:50.409384 (+ 7801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:50.409392 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:50.409434 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:50.409949 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.409965 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.412515 (+ 2550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.412524 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.415962 (+ 3438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.415977 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.418040 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.418046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.418271 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.418305 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 06:52:50.418413 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 06:52:50.418553 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":830,"mutex_wait_us":37,"thread_start_us":1110,"threads_started":1}
I20260809 06:52:50.419906 18982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.400628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45064 (local address 127.10.205.66:41835)
0809 06:52:50.408521 (+ 7893us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.408535 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.408578 (+ 43us) server_negotiation.cc:407] Connection header received
0809 06:52:50.408719 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.408731 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.409101 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.409393 (+ 292us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:50.410192 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.412210 (+ 2018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.416163 (+ 3953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.417513 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.417642 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.417871 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.419436 (+ 1565us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.419624 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7613,"thread_start_us":7494,"threads_started":1}
I20260809 06:52:50.422153 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.402144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52756 (local address 127.10.205.67:37399)
0809 06:52:50.413511 (+ 11367us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.413517 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.414176 (+ 659us) server_negotiation.cc:407] Connection header received
0809 06:52:50.414523 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.414551 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.414857 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.415064 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:50.415670 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.417189 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.419674 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.421182 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.421280 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.421436 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.421692 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.421835 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11168,"thread_start_us":11361,"threads_started":1}
I20260809 06:52:50.422250 18983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.401861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37399 (local address 127.0.0.1:52756)
0809 06:52:50.414026 (+ 12165us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:50.414047 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:50.414311 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:50.415034 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:50.415039 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:50.415062 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:50.415492 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.415503 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.417489 (+ 1986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.417494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.419510 (+ 2016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.419526 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.421354 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.421361 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.421523 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.421554 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 06:52:50.421664 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 06:52:50.421805 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12038,"mutex_wait_us":1,"thread_start_us":11925,"threads_started":1}
I20260809 06:52:50.424769 18985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.414218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:34113 (local address 127.0.0.1:57630)
0809 06:52:50.414906 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:50.414922 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:50.415700 (+ 778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:50.416765 (+ 1065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:50.416771 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:50.416797 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:50.417225 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.417237 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.419110 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.419115 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.420863 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.420876 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.423946 (+ 3070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.423952 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.424125 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.424162 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 06:52:50.424252 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 06:52:50.424421 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":414,"threads_started":1}
I20260809 06:52:50.424314 18725 tablet_service.cc:1467] Processing CreateTablet for tablet 75c661a4cee54173b27913601ee52dbf (DEFAULT_TABLE table=test-table [id=ca8276e3fb9f48779c165aace51998e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:50.425756 18986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.414516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57630 (local address 127.10.205.65:34113)
0809 06:52:50.416200 (+ 1684us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.416211 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.416238 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:52:50.416350 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.416357 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.416559 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.416754 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:50.417457 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.418949 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.421021 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.423706 (+ 2685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.423898 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.424106 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.425140 (+ 1034us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.425478 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1486,"thread_start_us":1355,"threads_started":1}
I20260809 06:52:50.425881 18725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75c661a4cee54173b27913601ee52dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:50.426182 18877 tablet_service.cc:1467] Processing CreateTablet for tablet 75c661a4cee54173b27913601ee52dbf (DEFAULT_TABLE table=test-table [id=ca8276e3fb9f48779c165aace51998e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:50.427703 18877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75c661a4cee54173b27913601ee52dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:50.428841 18568 tablet_service.cc:1467] Processing CreateTablet for tablet 75c661a4cee54173b27913601ee52dbf (DEFAULT_TABLE table=test-table [id=ca8276e3fb9f48779c165aace51998e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:50.430136 18568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75c661a4cee54173b27913601ee52dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:50.443105 18987 tablet_bootstrap.cc:492] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77: Bootstrap starting.
I20260809 06:52:50.446811 18987 tablet_bootstrap.cc:654] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:50.447227 18989 tablet_bootstrap.cc:492] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a: Bootstrap starting.
I20260809 06:52:50.448577 18987 log.cc:824] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:50.454114 18988 tablet_bootstrap.cc:492] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21: Bootstrap starting.
I20260809 06:52:50.454188 18987 tablet_bootstrap.cc:492] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77: No bootstrap required, opened a new log
I20260809 06:52:50.454500 18987 ts_tablet_manager.cc:1397] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260809 06:52:50.456629 18989 tablet_bootstrap.cc:654] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:50.457957 18989 log.cc:824] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:50.462472 18988 tablet_bootstrap.cc:654] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:50.463769 18988 log.cc:824] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:50.465651 18987 raft_consensus.cc:348] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } }
I20260809 06:52:50.466172 18987 raft_consensus.cc:374] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:50.466281 18987 raft_consensus.cc:729] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2118f5e30354ee5bfa22b07a088cf77, State: Initialized, Role: FOLLOWER
I20260809 06:52:50.467165 18987 consensus_queue.cc:260] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } }
I20260809 06:52:50.467469 18988 tablet_bootstrap.cc:492] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21: No bootstrap required, opened a new log
I20260809 06:52:50.467532 18989 tablet_bootstrap.cc:492] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a: No bootstrap required, opened a new log
I20260809 06:52:50.467826 18989 ts_tablet_manager.cc:1397] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.000s
I20260809 06:52:50.468704 18988 ts_tablet_manager.cc:1397] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.000s
I20260809 06:52:50.471948 18987 ts_tablet_manager.cc:1428] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77: Time spent starting tablet: real 0.017s user 0.016s sys 0.000s
I20260809 06:52:50.479936 18989 raft_consensus.cc:348] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } }
I20260809 06:52:50.479936 18988 raft_consensus.cc:348] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } }
I20260809 06:52:50.480486 18989 raft_consensus.cc:374] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:50.480607 18989 raft_consensus.cc:729] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cdb3675201d49ce8963d7c62d33497a, State: Initialized, Role: FOLLOWER
I20260809 06:52:50.480623 18988 raft_consensus.cc:374] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:50.480827 18988 raft_consensus.cc:729] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82dbd80f566f4508a0cfc45c590dac21, State: Initialized, Role: FOLLOWER
I20260809 06:52:50.481411 18988 consensus_queue.cc:260] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } }
I20260809 06:52:50.481401 18989 consensus_queue.cc:260] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } }
I20260809 06:52:50.484227 18947 heartbeater.cc:503] Master 127.10.205.126:45343 was elected leader, sending a full tablet report...
I20260809 06:52:50.486317 18989 ts_tablet_manager.cc:1428] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a: Time spent starting tablet: real 0.018s user 0.010s sys 0.005s
I20260809 06:52:50.487311 18988 ts_tablet_manager.cc:1428] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21: Time spent starting tablet: real 0.018s user 0.014s sys 0.000s
I20260809 06:52:50.490747 18795 heartbeater.cc:503] Master 127.10.205.126:45343 was elected leader, sending a full tablet report...
W20260809 06:52:50.519935 18640 tablet.cc:2369] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:52:50.524852 18995 raft_consensus.cc:482] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:50.525198 18995 raft_consensus.cc:504] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } }
I20260809 06:52:50.527077 18995 leader_election.cc:288] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cdb3675201d49ce8963d7c62d33497a (127.10.205.67:37399), d2118f5e30354ee5bfa22b07a088cf77 (127.10.205.65:34113)
I20260809 06:52:50.535642 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.527606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:46975 (local address 127.10.205.67:37399)
0809 06:52:50.527853 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.527860 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.528275 (+ 415us) server_negotiation.cc:407] Connection header received
0809 06:52:50.528779 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.528788 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.528876 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.528948 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:50.529654 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.530713 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.533315 (+ 2602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.534549 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.534722 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.534826 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.535199 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.535401 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260809 06:52:50.535703 18986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.528320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:48359 (local address 127.10.205.65:34113)
0809 06:52:50.528561 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.528568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.529269 (+ 701us) server_negotiation.cc:407] Connection header received
0809 06:52:50.529479 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.529483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.529553 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.529663 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:50.530202 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.531120 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.533482 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.534728 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.534922 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.534997 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.535368 (+ 371us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.535493 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:52:50.535799 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.528112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:34113 (local address 127.10.205.66:48359)
0809 06:52:50.529017 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:50.529033 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:50.529330 (+ 297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:50.529698 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:50.529701 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:50.529722 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:50.530046 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.530055 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.531251 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.531256 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.533340 (+ 2084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.533351 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.534928 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.534933 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.535194 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.535221 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 06:52:50.535297 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 06:52:50.535394 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"mutex_wait_us":37,"thread_start_us":590,"threads_started":1}
I20260809 06:52:50.535843 18996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.527334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37399 (local address 127.10.205.66:46975)
0809 06:52:50.528077 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:50.528098 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:50.528410 (+ 312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:50.529013 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:50.529018 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:50.529052 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:50.529516 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.529527 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.530864 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.530868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.533160 (+ 2292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:50.533176 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.534761 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.534765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:50.535025 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.535070 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 06:52:50.535170 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 06:52:50.535317 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":26,"thread_start_us":363,"threads_started":1}
I20260809 06:52:50.537009 18589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75c661a4cee54173b27913601ee52dbf" candidate_uuid: "82dbd80f566f4508a0cfc45c590dac21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2118f5e30354ee5bfa22b07a088cf77" is_pre_election: true
I20260809 06:52:50.537196 18899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75c661a4cee54173b27913601ee52dbf" candidate_uuid: "82dbd80f566f4508a0cfc45c590dac21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cdb3675201d49ce8963d7c62d33497a" is_pre_election: true
I20260809 06:52:50.537526 18589 raft_consensus.cc:2454] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82dbd80f566f4508a0cfc45c590dac21 in term 0.
I20260809 06:52:50.537840 18899 raft_consensus.cc:2454] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82dbd80f566f4508a0cfc45c590dac21 in term 0.
I20260809 06:52:50.538267 18674 leader_election.cc:302] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82dbd80f566f4508a0cfc45c590dac21, d2118f5e30354ee5bfa22b07a088cf77; no voters:
I20260809 06:52:50.538697 18995 raft_consensus.cc:2781] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:50.538848 18995 raft_consensus.cc:482] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:50.538978 18995 raft_consensus.cc:3037] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:50.541476 18995 raft_consensus.cc:504] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } }
I20260809 06:52:50.542158 18995 leader_election.cc:288] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [CANDIDATE]: Term 1 election: Requested vote from peers 0cdb3675201d49ce8963d7c62d33497a (127.10.205.67:37399), d2118f5e30354ee5bfa22b07a088cf77 (127.10.205.65:34113)
I20260809 06:52:50.542616 18899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75c661a4cee54173b27913601ee52dbf" candidate_uuid: "82dbd80f566f4508a0cfc45c590dac21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cdb3675201d49ce8963d7c62d33497a"
I20260809 06:52:50.542759 18589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75c661a4cee54173b27913601ee52dbf" candidate_uuid: "82dbd80f566f4508a0cfc45c590dac21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2118f5e30354ee5bfa22b07a088cf77"
I20260809 06:52:50.542819 18899 raft_consensus.cc:3037] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:50.542989 18589 raft_consensus.cc:3037] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:50.545261 18899 raft_consensus.cc:2454] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82dbd80f566f4508a0cfc45c590dac21 in term 1.
I20260809 06:52:50.545463 18589 raft_consensus.cc:2454] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82dbd80f566f4508a0cfc45c590dac21 in term 1.
I20260809 06:52:50.545735 18674 leader_election.cc:302] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cdb3675201d49ce8963d7c62d33497a, 82dbd80f566f4508a0cfc45c590dac21; no voters:
I20260809 06:52:50.546052 18995 raft_consensus.cc:2781] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:50.546587 18995 raft_consensus.cc:686] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 1 LEADER]: Becoming Leader. State: Replica: 82dbd80f566f4508a0cfc45c590dac21, State: Running, Role: LEADER
W20260809 06:52:50.547075 18949 tablet.cc:2369] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:52:50.547209 18995 consensus_queue.cc:237] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } }
I20260809 06:52:50.552914 17599 catalog_manager.cc:5495] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82dbd80f566f4508a0cfc45c590dac21 (127.10.205.66). New cstate: current_term: 1 leader_uuid: "82dbd80f566f4508a0cfc45c590dac21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } health_report { overall_health: UNKNOWN } } }
I20260809 06:52:50.607128 18982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.601936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41034 (local address 127.10.205.66:41835)
0809 06:52:50.602125 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.602130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.602165 (+ 35us) server_negotiation.cc:407] Connection header received
0809 06:52:50.602291 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.602295 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.602415 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.602559 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:50.602899 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.603674 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.605052 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.605460 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.605552 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.605981 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:50.606512 (+ 531us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:50.606622 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.606721 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.606797 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:52:50.615429 18589 raft_consensus.cc:1261] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77 [term 1 FOLLOWER]: Refusing update from remote peer 82dbd80f566f4508a0cfc45c590dac21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:50.615464 18899 raft_consensus.cc:1261] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a [term 1 FOLLOWER]: Refusing update from remote peer 82dbd80f566f4508a0cfc45c590dac21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:50.616477 18998 consensus_queue.cc:1035] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:50.616899 18995 consensus_queue.cc:1035] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:50.651010 17598 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:50.651345 17598 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:50.661854 17598 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 101ca3fbfe034a68b712a15edf416cc8: Sending DeleteTablet for 3 replicas of tablet 75c661a4cee54173b27913601ee52dbf
I20260809 06:52:50.662950 18725 tablet_service.cc:1514] Processing DeleteTablet for tablet 75c661a4cee54173b27913601ee52dbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:50 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:45064
I20260809 06:52:50.663218 18877 tablet_service.cc:1514] Processing DeleteTablet for tablet 75c661a4cee54173b27913601ee52dbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:50 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:52756
I20260809 06:52:50.666581 18568 tablet_service.cc:1514] Processing DeleteTablet for tablet 75c661a4cee54173b27913601ee52dbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:50 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:57630
I20260809 06:52:50.681382 19013 tablet_replica.cc:330] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77: stopping tablet replica
I20260809 06:52:50.682078 19013 raft_consensus.cc:2229] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:50.683588 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 17566
I20260809 06:52:50.682797 19013 raft_consensus.cc:2258] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:50.685030 17632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:50.687451 19013 ts_tablet_manager.cc:1905] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:50.693917 19011 tablet_replica.cc:330] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21: stopping tablet replica
I20260809 06:52:50.694532 19011 raft_consensus.cc:2229] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:50.695340 19012 tablet_replica.cc:330] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a: stopping tablet replica
I20260809 06:52:50.695719 19012 raft_consensus.cc:2229] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:50.696177 19012 raft_consensus.cc:2258] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:50.697113 19011 raft_consensus.cc:2258] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:50.698385 19013 ts_tablet_manager.cc:1918] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:50.698556 19013 log.cc:1196] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/75c661a4cee54173b27913601ee52dbf
I20260809 06:52:50.699172 19013 ts_tablet_manager.cc:1939] T 75c661a4cee54173b27913601ee52dbf P d2118f5e30354ee5bfa22b07a088cf77: Deleting consensus metadata
I20260809 06:52:50.701388 19012 ts_tablet_manager.cc:1905] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:50.701835 19011 ts_tablet_manager.cc:1905] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:50.708611 19012 ts_tablet_manager.cc:1918] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:50.708811 19012 log.cc:1196] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/75c661a4cee54173b27913601ee52dbf
I20260809 06:52:50.709405 19012 ts_tablet_manager.cc:1939] T 75c661a4cee54173b27913601ee52dbf P 0cdb3675201d49ce8963d7c62d33497a: Deleting consensus metadata
I20260809 06:52:50.709491 19011 ts_tablet_manager.cc:1918] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:50.709683 19011 log.cc:1196] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/75c661a4cee54173b27913601ee52dbf
I20260809 06:52:50.710304 19011 ts_tablet_manager.cc:1939] T 75c661a4cee54173b27913601ee52dbf P 82dbd80f566f4508a0cfc45c590dac21: Deleting consensus metadata
I20260809 06:52:50.726518 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.672400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35516 (local address 127.10.205.125:42637)
0809 06:52:50.672632 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.672642 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.681919 (+ 9277us) server_negotiation.cc:407] Connection header received
0809 06:52:50.682985 (+ 1066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.682994 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.683141 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.683234 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:50.697758 (+ 14524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.698964 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.713228 (+ 14264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.713690 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.713854 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.720213 (+ 6359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:50.720221 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:50.720243 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:50.720316 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:50.723495 (+ 3179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.724237 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.724242 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.724244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.724432 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.724832 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.724838 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.724841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.725128 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:50.725425 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.725873 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.726145 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 06:52:50.746312 18950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.681979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57572 (local address 127.10.205.124:34223)
0809 06:52:50.682212 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.682220 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.726681 (+ 44461us) server_negotiation.cc:407] Connection header received
0809 06:52:50.726971 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.726977 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.727070 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.727143 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:50.729399 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.730663 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.732836 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.733636 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.733758 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.738185 (+ 4427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:50.738196 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:50.738205 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:50.738260 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:50.742831 (+ 4571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.743748 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.743754 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.743758 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.743921 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.744432 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.744438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.744441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.744825 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:50.745058 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.745649 (+ 591us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.745897 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 06:52:50.852771 17583 catalog_manager.cc:4841] TS d2118f5e30354ee5bfa22b07a088cf77 (127.10.205.65:34113): tablet 75c661a4cee54173b27913601ee52dbf (table test-table [id=ca8276e3fb9f48779c165aace51998e5]) successfully deleted
I20260809 06:52:50.853233 17583 catalog_manager.cc:4841] TS 82dbd80f566f4508a0cfc45c590dac21 (127.10.205.66:41835): tablet 75c661a4cee54173b27913601ee52dbf (table test-table [id=ca8276e3fb9f48779c165aace51998e5]) successfully deleted
I20260809 06:52:50.853488 17583 catalog_manager.cc:4841] TS 0cdb3675201d49ce8963d7c62d33497a (127.10.205.67:37399): tablet 75c661a4cee54173b27913601ee52dbf (table test-table [id=ca8276e3fb9f48779c165aace51998e5]) successfully deleted
I20260809 06:52:50.853760 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 17566
I20260809 06:52:50.912452 18950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.890639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57582 (local address 127.10.205.124:34223)
0809 06:52:50.892323 (+ 1684us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.892332 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.892358 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:52:50.892445 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.892454 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.892562 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.892683 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:50.895889 (+ 3206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.897438 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.900726 (+ 3288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.901420 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.901533 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.905389 (+ 3856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:50.905398 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:50.905405 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:50.905457 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:50.908980 (+ 3523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.909855 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.909863 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.909869 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.910037 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.910539 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.910545 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.910549 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.910941 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:50.911215 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.911618 (+ 403us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.911881 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1436}
I20260809 06:52:50.916877 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:50.891439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35518 (local address 127.10.205.125:42637)
0809 06:52:50.891625 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:50.891631 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:50.900824 (+ 9193us) server_negotiation.cc:407] Connection header received
0809 06:52:50.901205 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:50.901214 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:50.901333 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:50.901424 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:50.904574 (+ 3150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.905346 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.907173 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:50.907655 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:50.907803 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:50.910844 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:50.910850 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:50.910853 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:50.910888 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:50.914149 (+ 3261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.914852 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.914858 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.914862 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.915002 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:50.915418 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:50.915422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:50.915424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:50.915701 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:50.915957 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:50.916307 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 06:52:50.916555 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:52:51.636415 19023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:51.635507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.66:51243)
0809 06:52:51.636051 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:51.636175 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":247,"threads_started":1}
W20260809 06:52:51.636860 18795 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:45343 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
I20260809 06:52:51.641727 19024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:51.640901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.67:45033)
0809 06:52:51.641420 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:51.641542 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":285,"threads_started":1}
W20260809 06:52:51.642171 18947 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:45343 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
I20260809 06:52:51.648437 19025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:51.647241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.65:48027)
0809 06:52:51.648028 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:51.648176 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":546,"threads_started":1}
W20260809 06:52:51.649181 18638 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:45343 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
I20260809 06:52:52.160889 19026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 101ca3fbfe034a68b712a15edf416cc8)
I20260809 06:52:52.161221 19026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } }
I20260809 06:52:52.162209 19027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 101ca3fbfe034a68b712a15edf416cc8)
I20260809 06:52:52.162422 19027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } }
I20260809 06:52:52.162750 19026 leader_election.cc:288] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343), 1c5c422506294437bf14595e48292673 (127.10.205.125:42637)
I20260809 06:52:52.163334 19027 leader_election.cc:288] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343), 290370fbd1d2488aa16e25d514a89532 (127.10.205.124:34223)
I20260809 06:52:52.164513 19029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.163407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:60828)
0809 06:52:52.163969 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.164199 (+ 230us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":278,"threads_started":1}
W20260809 06:52:52.164826 18227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
I20260809 06:52:52.165290 19028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.162866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:60814)
0809 06:52:52.164720 (+ 1854us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.164927 (+ 207us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1710,"thread_start_us":1584,"threads_started":1}
I20260809 06:52:52.167582 19035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.166534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:60840)
0809 06:52:52.167130 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.167365 (+ 235us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":330,"threads_started":1}
W20260809 06:52:52.167894 18227 leader_election.cc:334] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343): Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
W20260809 06:52:52.167984 18428 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
I20260809 06:52:52.170226 19031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.169526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:60850)
0809 06:52:52.169743 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.169975 (+ 232us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 06:52:52.170477 18428 leader_election.cc:334] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343): Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
I20260809 06:52:52.173535 19028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.164849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:42637 (local address 127.0.0.1:35532)
0809 06:52:52.165759 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.165784 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:52.165957 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:52.167251 (+ 1294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:52.167257 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:52.167288 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:52.167551 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:52.167568 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:52.169513 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:52.169518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:52.171538 (+ 2020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:52.171553 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:52.172963 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:52.172967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:52.173112 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:52.173138 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 06:52:52.173229 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 06:52:52.173340 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":772,"thread_start_us":2350,"threads_started":1}
I20260809 06:52:52.174044 19034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.165559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35532 (local address 127.10.205.125:42637)
0809 06:52:52.166758 (+ 1199us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:52.166767 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:52.166798 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:52:52.166892 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:52.166905 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:52.167030 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:52.167737 (+ 707us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:52.167946 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:52.169349 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:52.171696 (+ 2347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:52.172814 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:52.172966 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:52.173050 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:52.173286 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 06:52:52.173426 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":990,"thread_start_us":722,"threads_started":1}
I20260809 06:52:52.174703 18253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "290370fbd1d2488aa16e25d514a89532" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1c5c422506294437bf14595e48292673" is_pre_election: true
I20260809 06:52:52.175014 19036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.167419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57586 (local address 127.10.205.124:34223)
0809 06:52:52.168001 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:52.168007 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:52.168026 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:52:52.168099 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:52.168103 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:52.168200 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:52.168387 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:52.169064 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:52.170438 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:52.172582 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:52.173951 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:52.174126 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:52.174199 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:52.174526 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 06:52:52.174657 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":283,"threads_started":1}
I20260809 06:52:52.175156 19030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.163609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:34223 (local address 127.0.0.1:57586)
0809 06:52:52.164224 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.164243 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:52.164399 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:52.168401 (+ 4002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:52.168406 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:52.168432 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:52.168825 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:52.168841 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:52.170619 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:52.170625 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:52.172424 (+ 1799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:52.172436 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:52.174158 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:52.174167 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:52.174346 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:52.174389 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 06:52:52.174501 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 06:52:52.174645 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":20,"thread_start_us":400,"threads_started":1}
I20260809 06:52:52.175137 18253 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 290370fbd1d2488aa16e25d514a89532 in term 1.
I20260809 06:52:52.175788 18428 leader_election.cc:302] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5c422506294437bf14595e48292673, 290370fbd1d2488aa16e25d514a89532; no voters: 101ca3fbfe034a68b712a15edf416cc8
I20260809 06:52:52.175818 18455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c5c422506294437bf14595e48292673" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "290370fbd1d2488aa16e25d514a89532" is_pre_election: true
I20260809 06:52:52.176147 18455 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5c422506294437bf14595e48292673 in term 1.
I20260809 06:52:52.176360 19026 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 06:52:52.176524 19026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 101ca3fbfe034a68b712a15edf416cc8)
I20260809 06:52:52.176656 19026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 1 FOLLOWER]: Advancing to term 2
I20260809 06:52:52.176680 18226 leader_election.cc:302] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5c422506294437bf14595e48292673, 290370fbd1d2488aa16e25d514a89532; no voters: 101ca3fbfe034a68b712a15edf416cc8
I20260809 06:52:52.177055 19027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 06:52:52.177172 19027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 101ca3fbfe034a68b712a15edf416cc8)
I20260809 06:52:52.177268 19027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 1 FOLLOWER]: Advancing to term 2
I20260809 06:52:52.178984 19026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } }
I20260809 06:52:52.179440 19027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } }
I20260809 06:52:52.179685 19026 leader_election.cc:288] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [CANDIDATE]: Term 2 election: Requested vote from peers 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343), 1c5c422506294437bf14595e48292673 (127.10.205.125:42637)
I20260809 06:52:52.180203 19027 leader_election.cc:288] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [CANDIDATE]: Term 2 election: Requested vote from peers 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343), 290370fbd1d2488aa16e25d514a89532 (127.10.205.124:34223)
I20260809 06:52:52.180485 19028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.179946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:60854)
0809 06:52:52.180096 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.180223 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 06:52:52.181059 18253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "290370fbd1d2488aa16e25d514a89532" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1c5c422506294437bf14595e48292673"
I20260809 06:52:52.181461 19030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.180569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:60856)
0809 06:52:52.181202 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.181295 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":483}
I20260809 06:52:52.181490 18253 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 290370fbd1d2488aa16e25d514a89532 in current term 2: Already voted for candidate 1c5c422506294437bf14595e48292673 in this term.
I20260809 06:52:52.181618 18455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c5c422506294437bf14595e48292673" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "290370fbd1d2488aa16e25d514a89532"
I20260809 06:52:52.181900 19028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.181194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:60872)
0809 06:52:52.181576 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.181737 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296}
I20260809 06:52:52.181928 18455 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c5c422506294437bf14595e48292673 in current term 2: Already voted for candidate 290370fbd1d2488aa16e25d514a89532 in this term.
W20260809 06:52:52.182053 18428 leader_election.cc:334] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343): Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
I20260809 06:52:52.182374 18428 leader_election.cc:302] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 290370fbd1d2488aa16e25d514a89532; no voters: 101ca3fbfe034a68b712a15edf416cc8, 1c5c422506294437bf14595e48292673
I20260809 06:52:52.182628 19035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.182238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:60876)
0809 06:52:52.182398 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.182478 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 06:52:52.182631 19026 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260809 06:52:52.182802 18227 leader_election.cc:334] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343): Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
I20260809 06:52:52.182974 18227 leader_election.cc:302] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c5c422506294437bf14595e48292673; no voters: 101ca3fbfe034a68b712a15edf416cc8, 290370fbd1d2488aa16e25d514a89532
I20260809 06:52:52.183270 19027 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 06:52:52.638532 19038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.637692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.66:43885)
0809 06:52:52.638241 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.638353 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":268,"threads_started":1}
I20260809 06:52:52.643478 19039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.642783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.67:53199)
0809 06:52:52.643209 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.643297 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":234,"threads_started":1}
I20260809 06:52:52.650724 19040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:52.649898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.65:36699)
0809 06:52:52.650406 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:52.650497 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":268,"threads_started":1}
I20260809 06:52:53.640450 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:53.639627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.66:51911)
0809 06:52:53.640113 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:53.640207 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":242,"threads_started":1}
I20260809 06:52:53.645305 19042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:53.644473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.67:52367)
0809 06:52:53.644961 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:53.645067 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":220,"threads_started":1}
I20260809 06:52:53.653261 19043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:53.652436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.65:53475)
0809 06:52:53.652973 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:53.653072 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":332,"threads_started":1}
I20260809 06:52:53.946425 19044 raft_consensus.cc:482] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:53.946717 19044 raft_consensus.cc:504] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } }
I20260809 06:52:53.947400 19044 leader_election.cc:288] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343), 1c5c422506294437bf14595e48292673 (127.10.205.125:42637)
I20260809 06:52:53.948539 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:53.947630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:32900)
0809 06:52:53.948163 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:53.948356 (+ 193us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":278,"threads_started":1}
I20260809 06:52:53.948766 18253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "290370fbd1d2488aa16e25d514a89532" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1c5c422506294437bf14595e48292673" is_pre_election: true
I20260809 06:52:53.949030 18253 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 290370fbd1d2488aa16e25d514a89532 in term 2.
I20260809 06:52:53.949549 18428 leader_election.cc:302] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5c422506294437bf14595e48292673, 290370fbd1d2488aa16e25d514a89532; no voters:
I20260809 06:52:53.949826 19044 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260809 06:52:53.949965 19044 raft_consensus.cc:482] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:53.950081 19044 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 2 FOLLOWER]: Advancing to term 3
I20260809 06:52:53.950397 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:53.949989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:32904)
0809 06:52:53.950184 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:53.950269 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260809 06:52:53.950655 18428 leader_election.cc:334] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343): Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
I20260809 06:52:53.952490 19044 raft_consensus.cc:504] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } }
I20260809 06:52:53.953079 19044 leader_election.cc:288] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [CANDIDATE]: Term 3 election: Requested vote from peers 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343), 1c5c422506294437bf14595e48292673 (127.10.205.125:42637)
I20260809 06:52:53.953593 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:53.953147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:32916)
0809 06:52:53.953341 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:53.953443 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 06:52:53.953758 18253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "290370fbd1d2488aa16e25d514a89532" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1c5c422506294437bf14595e48292673"
I20260809 06:52:53.953999 18253 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 2 FOLLOWER]: Advancing to term 3
I20260809 06:52:53.954546 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:53.954278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:32930)
0809 06:52:53.954396 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:53.954453 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 06:52:53.954694 18428 leader_election.cc:334] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343): Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
I20260809 06:52:53.956395 18253 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290370fbd1d2488aa16e25d514a89532 in term 3.
I20260809 06:52:53.956881 18428 leader_election.cc:302] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c5c422506294437bf14595e48292673, 290370fbd1d2488aa16e25d514a89532; no voters: 101ca3fbfe034a68b712a15edf416cc8
I20260809 06:52:53.957270 19044 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 06:52:53.958012 19044 raft_consensus.cc:686] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [term 3 LEADER]: Becoming Leader. State: Replica: 290370fbd1d2488aa16e25d514a89532, State: Running, Role: LEADER
I20260809 06:52:53.958411 19044 consensus_queue.cc:237] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } }
I20260809 06:52:53.960031 19047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 290370fbd1d2488aa16e25d514a89532. Latest consensus state: current_term: 3 leader_uuid: "290370fbd1d2488aa16e25d514a89532" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } } }
I20260809 06:52:53.960333 19047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:53.960974 19049 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:53.964605 19049 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:53.965432 19049 catalog_manager.cc:1259] Loaded cluster ID: 644831ef554146cc8c7cace8637951b2
I20260809 06:52:53.965525 19049 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:53.966836 19049 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:53.967700 19049 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: Loaded TSK: 0
I20260809 06:52:53.968575 19049 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:52:54.042896 18445 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57582:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:52:54.050635 18445 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:54.055076 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.054691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:32944)
0809 06:52:54.054841 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.054937 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 06:52:54.055613 18253 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [term 3 FOLLOWER]: Refusing update from remote peer 290370fbd1d2488aa16e25d514a89532: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260809 06:52:54.056279 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.055818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:32960)
0809 06:52:54.055987 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.056089 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 06:52:54.056397 19047 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 06:52:54.056728 18428 consensus_peers.cc:487] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 -> Peer 101ca3fbfe034a68b712a15edf416cc8 (127.10.205.126:45343): Couldn't send request to peer 101ca3fbfe034a68b712a15edf416cc8. Status: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 06:52:54.059748 19051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 290370fbd1d2488aa16e25d514a89532. Latest consensus state: current_term: 3 leader_uuid: "290370fbd1d2488aa16e25d514a89532" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } } }
I20260809 06:52:54.060065 19051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:52:54.062285 19051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "290370fbd1d2488aa16e25d514a89532" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } } }
I20260809 06:52:54.062554 19051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c5c422506294437bf14595e48292673 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:52:54.063850 19056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "290370fbd1d2488aa16e25d514a89532" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "101ca3fbfe034a68b712a15edf416cc8" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45343 } } peers { permanent_uuid: "1c5c422506294437bf14595e48292673" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 42637 } attrs { promote: false } } peers { permanent_uuid: "290370fbd1d2488aa16e25d514a89532" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 34223 } attrs { promote: false } } }
I20260809 06:52:54.064321 19056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:54.081625 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.071017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:34113 (local address 127.0.0.1:50476)
0809 06:52:54.071734 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.071759 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:54.071911 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:54.073200 (+ 1289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:54.073208 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:54.073241 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:54.073776 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:54.073792 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.075751 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.075760 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:54.078458 (+ 2698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:54.078474 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.080715 (+ 2241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.080724 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:54.080981 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:54.081060 (+ 79us) client_negotiation.cc:769] Sending connection context
0809 06:52:54.081146 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 06:52:54.081295 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"mutex_wait_us":33}
I20260809 06:52:54.082890 19057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.071207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50476 (local address 127.10.205.65:34113)
0809 06:52:54.072769 (+ 1562us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:54.072776 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:54.072796 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:52:54.072872 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:54.072881 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:54.073001 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:54.073941 (+ 940us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:54.074209 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.075536 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.078695 (+ 3159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.080442 (+ 1747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.082157 (+ 1715us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:54.082262 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:54.082329 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 06:52:54.082475 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1415,"thread_start_us":1296,"threads_started":1}
I20260809 06:52:54.083101 19058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.071425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37399 (local address 127.0.0.1:49732)
0809 06:52:54.072130 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.072146 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:54.072304 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:54.073389 (+ 1085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:54.073397 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:54.073435 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:54.074033 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:54.074049 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.076352 (+ 2303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.076361 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:54.079353 (+ 2992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:54.079373 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.081865 (+ 2492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.081875 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:54.082193 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:54.082249 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 06:52:54.082333 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 06:52:54.082525 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"mutex_wait_us":27,"thread_start_us":878,"threads_started":1}
I20260809 06:52:54.084410 19059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.071608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49732 (local address 127.10.205.67:37399)
0809 06:52:54.072991 (+ 1383us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:54.072997 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:54.073018 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:52:54.073093 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:54.073099 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:54.073176 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:54.074230 (+ 1054us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:54.074476 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.076071 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.079640 (+ 3569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.081571 (+ 1931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.083387 (+ 1816us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:54.083675 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:54.083747 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 06:52:54.083955 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1251,"thread_start_us":1136,"threads_started":1}
I20260809 06:52:54.085675 18877 tablet_service.cc:1467] Processing CreateTablet for tablet 9fbf7b376ce748ab8578ed6a3ebce265 (DEFAULT_TABLE table=test-table [id=ae9abeccbacd4fbd81dc32e7ef592e51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:54.086241 18877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fbf7b376ce748ab8578ed6a3ebce265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:54.088675 18568 tablet_service.cc:1467] Processing CreateTablet for tablet 9fbf7b376ce748ab8578ed6a3ebce265 (DEFAULT_TABLE table=test-table [id=ae9abeccbacd4fbd81dc32e7ef592e51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:54.089161 18568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fbf7b376ce748ab8578ed6a3ebce265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:54.090556 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.072630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:41835 (local address 127.0.0.1:41050)
0809 06:52:54.081874 (+ 9244us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.081891 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:54.081982 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:54.085630 (+ 3648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:54.085634 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:54.085666 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:54.085851 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:54.085863 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.087267 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.087270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:54.088476 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:54.088488 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.089749 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.089755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:54.089952 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:54.089976 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:52:54.090081 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 06:52:54.090236 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9147,"thread_start_us":12104,"threads_started":1}
I20260809 06:52:54.090644 19061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.073061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41050 (local address 127.10.205.66:41835)
0809 06:52:54.085330 (+ 12269us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:54.085336 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:54.085358 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:52:54.085431 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:54.085435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:54.085494 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:54.085574 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:54.086050 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.087119 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.088634 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.089584 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.089738 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:54.089839 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:54.090120 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 06:52:54.090308 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12139,"thread_start_us":11994,"threads_started":1}
I20260809 06:52:54.092944 19063 tablet_bootstrap.cc:492] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a: Bootstrap starting.
I20260809 06:52:54.093155 18725 tablet_service.cc:1467] Processing CreateTablet for tablet 9fbf7b376ce748ab8578ed6a3ebce265 (DEFAULT_TABLE table=test-table [id=ae9abeccbacd4fbd81dc32e7ef592e51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:54.093636 18725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fbf7b376ce748ab8578ed6a3ebce265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:54.094726 19063 tablet_bootstrap.cc:654] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:54.097087 19063 tablet_bootstrap.cc:492] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a: No bootstrap required, opened a new log
I20260809 06:52:54.097450 19065 tablet_bootstrap.cc:492] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77: Bootstrap starting.
I20260809 06:52:54.097963 19063 ts_tablet_manager.cc:1397] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 06:52:54.098829 19063 raft_consensus.cc:348] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } }
I20260809 06:52:54.099112 19063 raft_consensus.cc:374] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:54.099220 19063 raft_consensus.cc:729] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cdb3675201d49ce8963d7c62d33497a, State: Initialized, Role: FOLLOWER
I20260809 06:52:54.099278 19065 tablet_bootstrap.cc:654] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:54.099510 19063 consensus_queue.cc:260] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } }
I20260809 06:52:54.100500 19063 ts_tablet_manager.cc:1428] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 06:52:54.101330 19068 tablet_bootstrap.cc:492] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21: Bootstrap starting.
I20260809 06:52:54.102713 19068 tablet_bootstrap.cc:654] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:54.104832 18946 heartbeater.cc:503] Master 127.10.205.124:34223 was elected leader, sending a full tablet report...
I20260809 06:52:54.105075 19068 tablet_bootstrap.cc:492] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21: No bootstrap required, opened a new log
I20260809 06:52:54.105233 19068 ts_tablet_manager.cc:1397] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 06:52:54.105989 19042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.105421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.67:44737)
0809 06:52:54.105723 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.105824 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
I20260809 06:52:54.106248 19068 raft_consensus.cc:348] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } }
I20260809 06:52:54.106531 19068 raft_consensus.cc:374] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:54.106629 19068 raft_consensus.cc:729] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82dbd80f566f4508a0cfc45c590dac21, State: Initialized, Role: FOLLOWER
I20260809 06:52:54.106868 19068 consensus_queue.cc:260] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } }
I20260809 06:52:54.107611 19065 tablet_bootstrap.cc:492] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77: No bootstrap required, opened a new log
I20260809 06:52:54.107767 19065 ts_tablet_manager.cc:1397] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.006s
I20260809 06:52:54.107808 19068 ts_tablet_manager.cc:1428] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 06:52:54.108570 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.108082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.66:43591)
0809 06:52:54.108312 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.108407 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 06:52:54.108706 19065 raft_consensus.cc:348] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } }
I20260809 06:52:54.109015 19065 raft_consensus.cc:374] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:54.109122 19065 raft_consensus.cc:729] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2118f5e30354ee5bfa22b07a088cf77, State: Initialized, Role: FOLLOWER
I20260809 06:52:54.109401 19065 consensus_queue.cc:260] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } }
I20260809 06:52:54.110154 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.109635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.66:54325)
0809 06:52:54.109879 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.109974 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260809 06:52:54.110406 19065 ts_tablet_manager.cc:1428] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 06:52:54.111135 18794 heartbeater.cc:503] Master 127.10.205.124:34223 was elected leader, sending a full tablet report...
I20260809 06:52:54.111480 19043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.111008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.65:35485)
0809 06:52:54.111192 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.111308 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 06:52:54.112643 19043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.112191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.65:45761)
0809 06:52:54.112417 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.112498 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260809 06:52:54.113683 18637 heartbeater.cc:503] Master 127.10.205.124:34223 was elected leader, sending a full tablet report...
W20260809 06:52:54.152567 18797 tablet.cc:2369] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:52:54.296484 19070 raft_consensus.cc:482] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:54.296736 19070 raft_consensus.cc:504] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } }
I20260809 06:52:54.297531 19070 leader_election.cc:288] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2118f5e30354ee5bfa22b07a088cf77 (127.10.205.65:34113), 0cdb3675201d49ce8963d7c62d33497a (127.10.205.67:37399)
I20260809 06:52:54.298260 18589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fbf7b376ce748ab8578ed6a3ebce265" candidate_uuid: "82dbd80f566f4508a0cfc45c590dac21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2118f5e30354ee5bfa22b07a088cf77" is_pre_election: true
I20260809 06:52:54.298277 18899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fbf7b376ce748ab8578ed6a3ebce265" candidate_uuid: "82dbd80f566f4508a0cfc45c590dac21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cdb3675201d49ce8963d7c62d33497a" is_pre_election: true
I20260809 06:52:54.298544 18899 raft_consensus.cc:2454] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82dbd80f566f4508a0cfc45c590dac21 in term 0.
I20260809 06:52:54.298532 18589 raft_consensus.cc:2454] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82dbd80f566f4508a0cfc45c590dac21 in term 0.
I20260809 06:52:54.299088 18674 leader_election.cc:302] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cdb3675201d49ce8963d7c62d33497a, 82dbd80f566f4508a0cfc45c590dac21; no voters:
I20260809 06:52:54.299368 19070 raft_consensus.cc:2781] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:54.299500 19070 raft_consensus.cc:482] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:54.299623 19070 raft_consensus.cc:3037] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:54.301800 19070 raft_consensus.cc:504] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } }
I20260809 06:52:54.302380 19070 leader_election.cc:288] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [CANDIDATE]: Term 1 election: Requested vote from peers d2118f5e30354ee5bfa22b07a088cf77 (127.10.205.65:34113), 0cdb3675201d49ce8963d7c62d33497a (127.10.205.67:37399)
I20260809 06:52:54.302914 18589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fbf7b376ce748ab8578ed6a3ebce265" candidate_uuid: "82dbd80f566f4508a0cfc45c590dac21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2118f5e30354ee5bfa22b07a088cf77"
I20260809 06:52:54.302981 18899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fbf7b376ce748ab8578ed6a3ebce265" candidate_uuid: "82dbd80f566f4508a0cfc45c590dac21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cdb3675201d49ce8963d7c62d33497a"
I20260809 06:52:54.303124 18589 raft_consensus.cc:3037] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:54.303239 18899 raft_consensus.cc:3037] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:54.305318 18589 raft_consensus.cc:2454] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82dbd80f566f4508a0cfc45c590dac21 in term 1.
I20260809 06:52:54.305347 18899 raft_consensus.cc:2454] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82dbd80f566f4508a0cfc45c590dac21 in term 1.
I20260809 06:52:54.305750 18674 leader_election.cc:302] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82dbd80f566f4508a0cfc45c590dac21, d2118f5e30354ee5bfa22b07a088cf77; no voters:
I20260809 06:52:54.306139 19070 raft_consensus.cc:2781] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:54.306594 19070 raft_consensus.cc:686] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 1 LEADER]: Becoming Leader. State: Replica: 82dbd80f566f4508a0cfc45c590dac21, State: Running, Role: LEADER
I20260809 06:52:54.306948 19070 consensus_queue.cc:237] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } } peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } }
I20260809 06:52:54.307713 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.307314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.66:33113)
0809 06:52:54.307487 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.307576 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 06:52:54.310132 18444 catalog_manager.cc:5495] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82dbd80f566f4508a0cfc45c590dac21 (127.10.205.66). New cstate: current_term: 1 leader_uuid: "82dbd80f566f4508a0cfc45c590dac21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82dbd80f566f4508a0cfc45c590dac21" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 41835 } health_report { overall_health: HEALTHY } } }
I20260809 06:52:54.326882 19061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.322351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41056 (local address 127.10.205.66:41835)
0809 06:52:54.322525 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:54.322530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:54.322551 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:52:54.322687 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:54.322691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:54.322765 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:54.322839 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:54.323192 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.323897 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.325294 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.325729 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.325824 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:54.326200 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:54.326311 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:54.326377 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:54.326525 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 06:52:54.326594 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:52:54.330130 18899 raft_consensus.cc:1261] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a [term 1 FOLLOWER]: Refusing update from remote peer 82dbd80f566f4508a0cfc45c590dac21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:54.330315 18589 raft_consensus.cc:1261] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77 [term 1 FOLLOWER]: Refusing update from remote peer 82dbd80f566f4508a0cfc45c590dac21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:54.330874 19072 consensus_queue.cc:1035] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cdb3675201d49ce8963d7c62d33497a" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:54.331240 19070 consensus_queue.cc:1035] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2118f5e30354ee5bfa22b07a088cf77" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 34113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:54.334393 19042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.333892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.67:58041)
0809 06:52:54.334155 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.334239 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260809 06:52:54.334412 19043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.333491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.65:39023)
0809 06:52:54.334032 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.334191 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379}
I20260809 06:52:54.345686 19075 mvcc.cc:205] Tried to move back new op lower bound from 7316514301250101248 to 7316514301163540480. Current Snapshot: MvccSnapshot[applied={T|T < 7316514301250101248}]
I20260809 06:52:54.347187 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.346484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.66:60829)
0809 06:52:54.346788 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.346930 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260809 06:52:54.347898 19042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.347283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.67:57621)
0809 06:52:54.347532 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.347667 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260809 06:52:54.348791 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.348303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.66:35015)
0809 06:52:54.348561 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.348638 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260809 06:52:54.351298 19077 mvcc.cc:205] Tried to move back new op lower bound from 7316514301250101248 to 7316514301163540480. Current Snapshot: MvccSnapshot[applied={T|T < 7316514301250101248}]
I20260809 06:52:54.352386 19043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.351345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.10.205.65:48299)
0809 06:52:54.352069 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.352179 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":604}
I20260809 06:52:54.358956 18445 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:54.359218 18445 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:54.364730 18445 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 290370fbd1d2488aa16e25d514a89532: Sending DeleteTablet for 3 replicas of tablet 9fbf7b376ce748ab8578ed6a3ebce265
I20260809 06:52:54.365799 18568 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fbf7b376ce748ab8578ed6a3ebce265 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:54 UTC) from {username='oryx', principal='oryx/127.10.205.124@KRBTEST.COM'} at 127.0.0.1:50476
I20260809 06:52:54.365868 18877 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fbf7b376ce748ab8578ed6a3ebce265 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:54 UTC) from {username='oryx', principal='oryx/127.10.205.124@KRBTEST.COM'} at 127.0.0.1:49732
I20260809 06:52:54.365924 18725 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fbf7b376ce748ab8578ed6a3ebce265 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:54 UTC) from {username='oryx', principal='oryx/127.10.205.124@KRBTEST.COM'} at 127.0.0.1:41050
I20260809 06:52:54.366639 19084 tablet_replica.cc:330] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77: stopping tablet replica
I20260809 06:52:54.367302 19084 raft_consensus.cc:2229] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:54.367766 19084 raft_consensus.cc:2258] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:54.368031 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 18432
I20260809 06:52:54.372748 19084 ts_tablet_manager.cc:1905] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:54.381309 19086 tablet_replica.cc:330] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a: stopping tablet replica
I20260809 06:52:54.381635 19086 raft_consensus.cc:2229] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:54.382843 19086 raft_consensus.cc:2258] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:54.384495 19086 ts_tablet_manager.cc:1905] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:54.384786 19084 ts_tablet_manager.cc:1918] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:54.384950 19084 log.cc:1196] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/9fbf7b376ce748ab8578ed6a3ebce265
I20260809 06:52:54.385504 19084 ts_tablet_manager.cc:1939] T 9fbf7b376ce748ab8578ed6a3ebce265 P d2118f5e30354ee5bfa22b07a088cf77: Deleting consensus metadata
I20260809 06:52:54.386818 18427 catalog_manager.cc:4841] TS d2118f5e30354ee5bfa22b07a088cf77 (127.10.205.65:34113): tablet 9fbf7b376ce748ab8578ed6a3ebce265 (table test-table [id=ae9abeccbacd4fbd81dc32e7ef592e51]) successfully deleted
I20260809 06:52:54.387588 19085 tablet_replica.cc:330] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21: stopping tablet replica
I20260809 06:52:54.387815 19085 raft_consensus.cc:2229] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:54.388236 19085 raft_consensus.cc:2258] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:54.389456 19085 ts_tablet_manager.cc:1905] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:54.391297 19086 ts_tablet_manager.cc:1918] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:54.391448 19086 log.cc:1196] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/9fbf7b376ce748ab8578ed6a3ebce265
I20260809 06:52:54.391884 19086 ts_tablet_manager.cc:1939] T 9fbf7b376ce748ab8578ed6a3ebce265 P 0cdb3675201d49ce8963d7c62d33497a: Deleting consensus metadata
I20260809 06:52:54.393009 18427 catalog_manager.cc:4841] TS 0cdb3675201d49ce8963d7c62d33497a (127.10.205.67:37399): tablet 9fbf7b376ce748ab8578ed6a3ebce265 (table test-table [id=ae9abeccbacd4fbd81dc32e7ef592e51]) successfully deleted
I20260809 06:52:54.396198 19085 ts_tablet_manager.cc:1918] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:54.396411 19085 log.cc:1196] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/9fbf7b376ce748ab8578ed6a3ebce265
I20260809 06:52:54.396893 19085 ts_tablet_manager.cc:1939] T 9fbf7b376ce748ab8578ed6a3ebce265 P 82dbd80f566f4508a0cfc45c590dac21: Deleting consensus metadata
I20260809 06:52:54.398149 18427 catalog_manager.cc:4841] TS 82dbd80f566f4508a0cfc45c590dac21 (127.10.205.66:41835): tablet 9fbf7b376ce748ab8578ed6a3ebce265 (table test-table [id=ae9abeccbacd4fbd81dc32e7ef592e51]) successfully deleted
I20260809 06:52:54.400416 19057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.369211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50490 (local address 127.10.205.65:34113)
0809 06:52:54.369479 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:54.369488 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:54.382359 (+ 12871us) server_negotiation.cc:407] Connection header received
0809 06:52:54.382556 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:54.382570 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:54.382703 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:54.382864 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:54.385366 (+ 2502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.386436 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.388658 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.389368 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.389486 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:54.393820 (+ 4334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:54.393838 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:54.393855 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:54.393889 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:54.397270 (+ 3381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:54.398230 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:54.398241 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:54.398244 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:54.398432 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:54.398815 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:54.398818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:54.398820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:54.399196 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:54.399426 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:54.399896 (+ 470us) server_negotiation.cc:299] Negotiation successful
0809 06:52:54.400067 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:52:54.401161 18632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:54.497114 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 18432
I20260809 06:52:54.521761 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 18650
I20260809 06:52:54.537385 19061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.522682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41066 (local address 127.10.205.66:41835)
0809 06:52:54.522874 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:54.522880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:54.522924 (+ 44us) server_negotiation.cc:407] Connection header received
0809 06:52:54.523092 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:54.523098 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:54.523179 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:54.523285 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:54.524709 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.525821 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.527162 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.527805 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.527935 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:54.530803 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:54.530823 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:54.530843 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:54.530895 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:54.534470 (+ 3575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:54.535252 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:54.535262 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:54.535266 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:54.535452 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:54.535849 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:54.535856 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:54.535862 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:54.536330 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:54.536563 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:54.536943 (+ 380us) server_negotiation.cc:299] Negotiation successful
0809 06:52:54.537119 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 06:52:54.538071 18789 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:54.648808 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.647927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:32964)
0809 06:52:54.648483 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.648582 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":313,"threads_started":1}
I20260809 06:52:54.650120 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.649806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45343 (local address 127.0.0.1:32974)
0809 06:52:54.649940 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:54.650013 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:45343: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 06:52:54.662531 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 18650
I20260809 06:52:54.688225 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 18807
I20260809 06:52:54.701776 19093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:54.689088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49748 (local address 127.10.205.67:37399)
0809 06:52:54.689583 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:54.689587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:54.689605 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:52:54.689664 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:54.689668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:54.689727 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:54.689831 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:54.691196 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.691913 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.693178 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:54.693597 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:54.693712 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:54.696212 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:54.696227 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:54.696243 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:54.696336 (+ 93us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:54.699043 (+ 2707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:54.699693 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:54.699700 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:54.699703 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:54.699852 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:54.700188 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:54.700191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:54.700193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:54.700775 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:54.701029 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:54.701313 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 06:52:54.701498 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":287,"threads_started":1}
I20260809 06:52:54.702467 18941 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:54.797031 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 18807
I20260809 06:52:54.816949 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 18098
I20260809 06:52:54.818115 18275 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:54.940429 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 18098
I20260809 06:52:54.964512 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 18205
I20260809 06:52:54.965646 18478 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:52:55.088541 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 18205
2026-08-09T06:52:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11810 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:52:55 dist-test-slave-0b58 krb5kdc[19099](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:52:55 dist-test-slave-0b58 krb5kdc[19099](info): set up 2 sockets
Aug 09 06:52:55 dist-test-slave-0b58 krb5kdc[19099](info): commencing operation
krb5kdc: starting...
W20260809 06:52:56.228782 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.008s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:52:56 dist-test-slave-0b58 krb5kdc[19099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258376, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:52:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:52:56Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.126.keytab.
Entry for principal oryx/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.126.keytab.
I20260809 06:52:56.508006 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:36497
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.126.keytab
--principal=oryx/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:39229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:36497
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:56.848636 19113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:56.849066 19113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:56.849241 19113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:56.856722 19113 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:52:56.856899 19113 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 06:52:56.857008 19113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:56.857128 19113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:56.857225 19113 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:52:56.857316 19113 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:52:56.868949 19113 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:39229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:36497
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.126.keytab
--principal=oryx/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:36497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:56.870398 19113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:56.871799 19113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:56.885129 19122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:56.885233 19120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:56.885145 19118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:56.885489 19113 server_base.cc:1034] running on GCE node
I20260809 06:52:56.886631 19113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:56.888054 19113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:56.889281 19113 hybrid_clock.cc:648] HybridClock initialized: now 1786258376889200 us; error 48 us; skew 500 ppm
I20260809 06:52:56.889676 19113 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:56 dist-test-slave-0b58 krb5kdc[19099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258376, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:56.899820 19113 init.cc:377] Logged in from keytab as oryx/127.10.205.126@KRBTEST.COM (short username oryx)
I20260809 06:52:56.901582 19113 webserver.cc:460] Webserver started at http://127.10.205.126:38865/ using document root <none> and password file <none>
I20260809 06:52:56.902336 19113 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:56.902431 19113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:56.902724 19113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:56.905992 19113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "a663e22998394f79b43f79517d586795"
format_stamp: "Formatted at 2026-08-09 06:52:56 on dist-test-slave-0b58"
server_key: "3b913a7a29c63f4c3bf27a28989a349f"
server_key_iv: "adf9461200322e4c10c6ecda264c9024"
server_key_version: "encryptionkey@0"
I20260809 06:52:56.906838 19113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "a663e22998394f79b43f79517d586795"
format_stamp: "Formatted at 2026-08-09 06:52:56 on dist-test-slave-0b58"
server_key: "3b913a7a29c63f4c3bf27a28989a349f"
server_key_iv: "adf9461200322e4c10c6ecda264c9024"
server_key_version: "encryptionkey@0"
I20260809 06:52:56.912232 19113 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260809 06:52:56.915859 19129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:56.917318 19113 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 06:52:56.917460 19113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "a663e22998394f79b43f79517d586795"
format_stamp: "Formatted at 2026-08-09 06:52:56 on dist-test-slave-0b58"
server_key: "3b913a7a29c63f4c3bf27a28989a349f"
server_key_iv: "adf9461200322e4c10c6ecda264c9024"
server_key_version: "encryptionkey@0"
I20260809 06:52:56.917655 19113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:56.934999 19113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:56.939412 19113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:56.939643 19113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:56.962874 19113 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:36497
I20260809 06:52:56.962888 19195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:36497 every 8 connection(s)
I20260809 06:52:56.964370 19113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:52:56.964955 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 19113
I20260809 06:52:56.965209 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:52:56.966075 11061 external_mini_cluster.cc:1428] Setting key 11bb105003ec156611d85002b2b01eb5
I20260809 06:52:56.969024 19196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 06:52:56 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258376, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:56.982707 19196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795: Bootstrap starting.
I20260809 06:52:56.986231 19196 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:56.987596 19196 log.cc:824] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:56.991380 19196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795: No bootstrap required, opened a new log
I20260809 06:52:56.991600 19200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:56.968245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35446 (local address 127.10.205.126:36497)
0809 06:52:56.969131 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:56.969146 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:56.969196 (+ 50us) server_negotiation.cc:407] Connection header received
0809 06:52:56.971588 (+ 2392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:56.971616 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:56.972141 (+ 525us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:56.972620 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:56.974033 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:56.976193 (+ 2160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:56.977531 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:56.978589 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:56.978796 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:56.983178 (+ 4382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:56.983187 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:56.983203 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:56.983244 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:56.986593 (+ 3349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:56.987458 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:56.987465 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:56.987472 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:56.987641 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:56.988069 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:56.988072 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:56.988074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:56.988746 (+ 672us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:56.988972 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:56.989584 (+ 612us) server_negotiation.cc:299] Negotiation successful
0809 06:52:56.990236 (+ 652us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":373,"threads_started":1}
I20260809 06:52:56.999892 19196 raft_consensus.cc:348] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a663e22998394f79b43f79517d586795" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 36497 } }
I20260809 06:52:57.000438 19196 raft_consensus.cc:374] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:57.000538 19196 raft_consensus.cc:729] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a663e22998394f79b43f79517d586795, State: Initialized, Role: FOLLOWER
I20260809 06:52:57.001044 19196 consensus_queue.cc:260] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a663e22998394f79b43f79517d586795" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 36497 } }
I20260809 06:52:57.001241 19196 raft_consensus.cc:388] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:52:57.001344 19196 raft_consensus.cc:482] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:52:57.001523 19196 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:57.004026 19196 raft_consensus.cc:504] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a663e22998394f79b43f79517d586795" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 36497 } }
I20260809 06:52:57.004611 19196 leader_election.cc:302] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a663e22998394f79b43f79517d586795; no voters:
I20260809 06:52:57.005245 19196 leader_election.cc:288] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:52:57.005411 19202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:57.006227 19202 raft_consensus.cc:686] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [term 1 LEADER]: Becoming Leader. State: Replica: a663e22998394f79b43f79517d586795, State: Running, Role: LEADER
I20260809 06:52:57.006769 19202 consensus_queue.cc:237] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a663e22998394f79b43f79517d586795" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 36497 } }
I20260809 06:52:57.007346 19196 sys_catalog.cc:564] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:52:57.009963 19204 sys_catalog.cc:455] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a663e22998394f79b43f79517d586795. Latest consensus state: current_term: 1 leader_uuid: "a663e22998394f79b43f79517d586795" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a663e22998394f79b43f79517d586795" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 36497 } } }
I20260809 06:52:57.010445 19204 sys_catalog.cc:458] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:57.010933 19203 sys_catalog.cc:455] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a663e22998394f79b43f79517d586795" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a663e22998394f79b43f79517d586795" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 36497 } } }
I20260809 06:52:57.011274 19203 sys_catalog.cc:458] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795 [sys.catalog]: This master's current role is: LEADER
I20260809 06:52:57.013576 19209 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:52:57.019870 19209 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:52:57.028877 19209 catalog_manager.cc:1347] Generated new cluster ID: 84b03ced841c4af5b370696538aa5a25
I20260809 06:52:57.029017 19209 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:52:57.042477 19209 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:52:57.043927 19209 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:52:57.055248 19209 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795: Generated new TSK 0
I20260809 06:52:57.056187 19209 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab.
Entry for principal oryx/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab.
I20260809 06:52:57.123777 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:36497
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab
--principal=oryx/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:39229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:57.466048 19223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:57.466377 19223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:57.466549 19223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:57.474085 19223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:57.474229 19223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:57.474390 19223 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:52:57.474519 19223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:52:57.485090 19223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:39229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab
--principal=oryx/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.205.126:36497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:57.486493 19223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:57.487874 19223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:57.502014 19231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:57.502164 19228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:57.502205 19229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:57.503183 19223 server_base.cc:1034] running on GCE node
I20260809 06:52:57.503885 19223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:57.504921 19223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:57.506165 19223 hybrid_clock.cc:648] HybridClock initialized: now 1786258377506089 us; error 31 us; skew 500 ppm
I20260809 06:52:57.506492 19223 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:57 dist-test-slave-0b58 krb5kdc[19099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258377, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:57.510104 19223 init.cc:377] Logged in from keytab as oryx/127.10.205.65@KRBTEST.COM (short username oryx)
I20260809 06:52:57.511754 19223 webserver.cc:460] Webserver started at http://127.10.205.65:42471/ using document root <none> and password file <none>
I20260809 06:52:57.512583 19223 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:57.512705 19223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:57.513067 19223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:57.516204 19223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "d03572e22c494ba7b7c9015b8c5dc36b"
format_stamp: "Formatted at 2026-08-09 06:52:57 on dist-test-slave-0b58"
server_key: "693fdc04ad894b9b19f588e69a5c4b93"
server_key_iv: "788a7e4e8b35dfe226e8a1ad8bbc6a62"
server_key_version: "encryptionkey@0"
I20260809 06:52:57.517139 19223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "d03572e22c494ba7b7c9015b8c5dc36b"
format_stamp: "Formatted at 2026-08-09 06:52:57 on dist-test-slave-0b58"
server_key: "693fdc04ad894b9b19f588e69a5c4b93"
server_key_iv: "788a7e4e8b35dfe226e8a1ad8bbc6a62"
server_key_version: "encryptionkey@0"
I20260809 06:52:57.523223 19223 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260809 06:52:57.526765 19238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:57.528154 19223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 06:52:57.528380 19223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "d03572e22c494ba7b7c9015b8c5dc36b"
format_stamp: "Formatted at 2026-08-09 06:52:57 on dist-test-slave-0b58"
server_key: "693fdc04ad894b9b19f588e69a5c4b93"
server_key_iv: "788a7e4e8b35dfe226e8a1ad8bbc6a62"
server_key_version: "encryptionkey@0"
I20260809 06:52:57.528635 19223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:57.541392 19223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:57.545650 19223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:57.545959 19223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:57.548771 19223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:57.548902 19223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:57.549055 19223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:57.549139 19223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:52:57 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258377, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:57.575035 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:57.549675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:54085 (local address 127.10.205.126:36497)
0809 06:52:57.550167 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:57.550174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:57.551576 (+ 1402us) server_negotiation.cc:407] Connection header received
0809 06:52:57.554122 (+ 2546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:57.554131 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:57.554248 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:57.554420 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:57.556740 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:57.558032 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:57.560721 (+ 2689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:57.561562 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:57.561722 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:57.566854 (+ 5132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:57.566864 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:57.566872 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:57.566929 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:57.570788 (+ 3859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:57.571855 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:57.571864 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:57.571869 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:57.572048 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:57.572798 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:57.572805 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:57.572811 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:57.573262 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:57.573473 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:57.574431 (+ 958us) server_negotiation.cc:299] Negotiation successful
0809 06:52:57.574669 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":243,"threads_started":1}
I20260809 06:52:57.576164 19250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:57.550462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:36497 (local address 127.10.205.65:54085)
0809 06:52:57.551366 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:57.551416 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:57.553697 (+ 2281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:57.554743 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:57.554752 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:57.555581 (+ 829us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:57.556478 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:57.556502 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:57.558209 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:57.558219 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:57.560561 (+ 2342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:57.560575 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:57.561824 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:57.561830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:57.562014 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:57.562952 (+ 938us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:57.562990 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:57.566514 (+ 3524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:57.570948 (+ 4434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:57.570958 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:57.570979 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:57.571686 (+ 707us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:57.572220 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:57.572227 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:57.572234 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:57.572613 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:57.573448 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:57.573459 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:57.573996 (+ 537us) client_negotiation.cc:769] Sending connection context
0809 06:52:57.574318 (+ 322us) client_negotiation.cc:240] Negotiation successful
0809 06:52:57.574927 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":391,"threads_started":1}
I20260809 06:52:57.597091 19223 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:32983
I20260809 06:52:57.597118 19368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:32983 every 8 connection(s)
I20260809 06:52:57.598881 19223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:52:57.598907 19331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:57.582679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:36497 (local address 127.10.205.65:51353)
0809 06:52:57.583625 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:57.583651 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:57.583813 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:57.584222 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:57.584228 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:57.585138 (+ 910us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:57.585940 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:57.585963 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:57.587243 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:57.587249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:57.588495 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:57.588508 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:57.589491 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:57.589500 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:57.589690 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:57.590470 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:57.590505 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:57.591719 (+ 1214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:57.596131 (+ 4412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:57.596151 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:57.596155 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:57.596681 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:57.597111 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:57.597116 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:57.597120 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:57.597388 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:57.598030 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:57.598033 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:57.598211 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 06:52:57.598314 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 06:52:57.598585 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":831,"thread_start_us":725,"threads_started":1}
I20260809 06:52:57.599119 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:57.583044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:51353 (local address 127.10.205.126:36497)
0809 06:52:57.583306 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:57.583315 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:57.583735 (+ 420us) server_negotiation.cc:407] Connection header received
0809 06:52:57.583957 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:57.583960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:57.584046 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:57.584165 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:57.586141 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:57.587068 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:57.588639 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:57.589276 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:57.589423 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:57.591951 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:57.591961 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:57.591968 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:57.592023 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:57.595908 (+ 3885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:57.596788 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:57.596795 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:57.596799 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:57.596974 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:57.597525 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:57.597530 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:57.597533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:57.597912 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:57.598072 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:57.598482 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 06:52:57.598719 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:52:57.601507 19370 heartbeater.cc:347] Connected to a master server at 127.10.205.126:36497
I20260809 06:52:57.601521 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 19223
I20260809 06:52:57.601747 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:52:57.601783 19370 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:57.602499 11061 external_mini_cluster.cc:1428] Setting key 4315f62e87a361b133dfa2ccb07661b9
I20260809 06:52:57.603463 19370 heartbeater.cc:511] Master 127.10.205.126:36497 requested a full tablet report, sending...
I20260809 06:52:57.605844 19147 ts_manager.cc:194] Registered new tserver with Master: d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983)
I20260809 06:52:57.608131 19147 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:54085
WARNING: no policy specified for oryx/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab.
Entry for principal oryx/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab.
I20260809 06:52:57.661577 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:36497
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab
--principal=oryx/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:39229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:58.008782 19374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:58.009176 19374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:58.009361 19374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:58.017012 19374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:58.017182 19374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:58.017325 19374 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:52:58.017462 19374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:52:58.028007 19374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:39229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab
--principal=oryx/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.205.126:36497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:58.029455 19374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:58.030848 19374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:58.044648 19379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:58.044682 19382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:58.044705 19380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:58.045619 19374 server_base.cc:1034] running on GCE node
I20260809 06:52:58.046273 19374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:58.047264 19374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:58.048516 19374 hybrid_clock.cc:648] HybridClock initialized: now 1786258378048422 us; error 63 us; skew 500 ppm
I20260809 06:52:58.048825 19374 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:58 dist-test-slave-0b58 krb5kdc[19099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258378, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:58.052445 19374 init.cc:377] Logged in from keytab as oryx/127.10.205.66@KRBTEST.COM (short username oryx)
I20260809 06:52:58.054001 19374 webserver.cc:460] Webserver started at http://127.10.205.66:41341/ using document root <none> and password file <none>
I20260809 06:52:58.054745 19374 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:58.054883 19374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:58.055224 19374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:58.058458 19374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "720d22b98b714aafa6272082084d56ca"
format_stamp: "Formatted at 2026-08-09 06:52:58 on dist-test-slave-0b58"
server_key: "148fd259a18d55b25a0d1ca81a0e4138"
server_key_iv: "3de8797579c81ade7b287a7fb41bbe78"
server_key_version: "encryptionkey@0"
I20260809 06:52:58.059316 19374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "720d22b98b714aafa6272082084d56ca"
format_stamp: "Formatted at 2026-08-09 06:52:58 on dist-test-slave-0b58"
server_key: "148fd259a18d55b25a0d1ca81a0e4138"
server_key_iv: "3de8797579c81ade7b287a7fb41bbe78"
server_key_version: "encryptionkey@0"
I20260809 06:52:58.065090 19374 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 06:52:58.069147 19391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:58.070525 19374 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260809 06:52:58.070731 19374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "720d22b98b714aafa6272082084d56ca"
format_stamp: "Formatted at 2026-08-09 06:52:58 on dist-test-slave-0b58"
server_key: "148fd259a18d55b25a0d1ca81a0e4138"
server_key_iv: "3de8797579c81ade7b287a7fb41bbe78"
server_key_version: "encryptionkey@0"
I20260809 06:52:58.070989 19374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:58.089247 19374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:58.093384 19374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:58.093668 19374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:58.096397 19374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:58.096503 19374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:58.096640 19374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:58.096720 19374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:52:58 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258378, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:58.124527 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.097039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:48453 (local address 127.10.205.126:36497)
0809 06:52:58.097260 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:58.097267 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:58.099222 (+ 1955us) server_negotiation.cc:407] Connection header received
0809 06:52:58.101870 (+ 2648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:58.101876 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:58.101971 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:58.102107 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:58.104532 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.105820 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.108640 (+ 2820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.109373 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.109519 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.115465 (+ 5946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:58.115470 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:58.115473 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:58.115510 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:58.119588 (+ 4078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:58.120811 (+ 1223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:58.120815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:58.120817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:58.121002 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:58.121660 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:58.121664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:58.121667 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:58.122155 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:58.122339 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:58.123714 (+ 1375us) server_negotiation.cc:299] Negotiation successful
0809 06:52:58.124015 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 06:52:58.126650 19400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.098132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:36497 (local address 127.10.205.66:48453)
0809 06:52:58.099059 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:58.099100 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:58.101461 (+ 2361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:58.102386 (+ 925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:58.102402 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:58.103277 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:58.104245 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.104320 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.106055 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.106062 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.108469 (+ 2407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.108481 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.109649 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.109657 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.109992 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.110893 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:58.110932 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:58.115171 (+ 4239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:58.119775 (+ 4604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:58.119789 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:58.119811 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:58.120622 (+ 811us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:58.121118 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:58.121123 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:58.121126 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:58.121488 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:58.122467 (+ 979us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:58.122480 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:58.123152 (+ 672us) client_negotiation.cc:769] Sending connection context
0809 06:52:58.123563 (+ 411us) client_negotiation.cc:240] Negotiation successful
0809 06:52:58.124396 (+ 833us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":448,"threads_started":1}
I20260809 06:52:58.148326 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.133089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:48135 (local address 127.10.205.126:36497)
0809 06:52:58.133382 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:58.133391 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:58.133929 (+ 538us) server_negotiation.cc:407] Connection header received
0809 06:52:58.134166 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:58.134175 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:58.134281 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:58.134417 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:58.135313 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.136721 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.138568 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.139424 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.139576 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.141915 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:58.141921 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:58.141926 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:58.141964 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:58.145419 (+ 3455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:58.146221 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:58.146227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:58.146231 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:58.146386 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:58.146777 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:58.146783 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:58.146786 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:58.147144 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:58.147316 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:58.147720 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 06:52:58.147950 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 06:52:58.148545 19494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.133096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:36497 (local address 127.10.205.66:48135)
0809 06:52:58.133812 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:58.133836 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:58.134009 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:58.134430 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:58.134433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:58.134864 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:58.135154 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.135162 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.136900 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.136905 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.138359 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.138372 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.139629 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.139634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.139773 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.140491 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:58.140508 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:58.141707 (+ 1199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:58.145633 (+ 3926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:58.145642 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:58.145646 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:58.146072 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:58.146508 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:58.146513 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:58.146516 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:58.146662 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:58.147279 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:58.147284 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:58.147472 (+ 188us) client_negotiation.cc:769] Sending connection context
0809 06:52:58.147624 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 06:52:58.147994 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":375,"threads_started":1}
I20260809 06:52:58.150117 19522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:40765 every 8 connection(s)
I20260809 06:52:58.150122 19374 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:40765
I20260809 06:52:58.151445 19374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:52:58.153812 19523 heartbeater.cc:347] Connected to a master server at 127.10.205.126:36497
I20260809 06:52:58.154145 19523 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:58.154812 19523 heartbeater.cc:511] Master 127.10.205.126:36497 requested a full tablet report, sending...
I20260809 06:52:58.156076 19147 ts_manager.cc:194] Registered new tserver with Master: 720d22b98b714aafa6272082084d56ca (127.10.205.66:40765)
I20260809 06:52:58.156953 19147 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:48453
I20260809 06:52:58.160677 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 19374
I20260809 06:52:58.160851 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:52:58.161254 11061 external_mini_cluster.cc:1428] Setting key 3ea5f8738ba77f987027368230246b12
WARNING: no policy specified for oryx/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab.
Entry for principal oryx/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab.
I20260809 06:52:58.219696 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:36497
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab
--principal=oryx/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:39229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:52:58.563782 19527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:52:58.564118 19527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:52:58.564352 19527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:52:58.572028 19527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:52:58.572326 19527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:52:58.572561 19527 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:52:58.572736 19527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:52:58.583537 19527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:39229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab
--principal=oryx/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.205.126:36497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:52:58.584981 19527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:52:58.586448 19527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:52:58.599731 19533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:58.600690 19534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:52:58.602108 19536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:52:58.602819 19527 server_base.cc:1034] running on GCE node
I20260809 06:52:58.603480 19527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:52:58.604454 19527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:52:58.605691 19527 hybrid_clock.cc:648] HybridClock initialized: now 1786258378605622 us; error 42 us; skew 500 ppm
I20260809 06:52:58.605978 19527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:52:58 dist-test-slave-0b58 krb5kdc[19099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258378, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:52:58.609186 19527 init.cc:377] Logged in from keytab as oryx/127.10.205.67@KRBTEST.COM (short username oryx)
I20260809 06:52:58.610613 19527 webserver.cc:460] Webserver started at http://127.10.205.67:41003/ using document root <none> and password file <none>
I20260809 06:52:58.610903 19370 heartbeater.cc:503] Master 127.10.205.126:36497 was elected leader, sending a full tablet report...
I20260809 06:52:58.611483 19527 fs_manager.cc:359] Metadata directory not provided
I20260809 06:52:58.611608 19527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:52:58.611955 19527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:52:58.614975 19527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625"
format_stamp: "Formatted at 2026-08-09 06:52:58 on dist-test-slave-0b58"
server_key: "8664a0816f98b5478956506a57a6679d"
server_key_iv: "e42ba1ae5fbb22d5fb4ddcb7b978591a"
server_key_version: "encryptionkey@0"
I20260809 06:52:58.615749 19527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625"
format_stamp: "Formatted at 2026-08-09 06:52:58 on dist-test-slave-0b58"
server_key: "8664a0816f98b5478956506a57a6679d"
server_key_iv: "e42ba1ae5fbb22d5fb4ddcb7b978591a"
server_key_version: "encryptionkey@0"
I20260809 06:52:58.621001 19527 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 06:52:58.624693 19544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:58.625942 19527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:52:58.626128 19527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625"
format_stamp: "Formatted at 2026-08-09 06:52:58 on dist-test-slave-0b58"
server_key: "8664a0816f98b5478956506a57a6679d"
server_key_iv: "e42ba1ae5fbb22d5fb4ddcb7b978591a"
server_key_version: "encryptionkey@0"
I20260809 06:52:58.626359 19527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:52:58.638387 19527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:52:58.642772 19527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:52:58.643071 19527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:52:58.645848 19527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:52:58.645962 19527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:52:58.646149 19527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:52:58.646231 19527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:52:58 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258378, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:58.671384 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.646530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:32805 (local address 127.10.205.126:36497)
0809 06:52:58.646805 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:58.646815 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:58.648068 (+ 1253us) server_negotiation.cc:407] Connection header received
0809 06:52:58.650442 (+ 2374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:58.650451 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:58.650550 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:58.650686 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:58.653144 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.654541 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.657266 (+ 2725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.657869 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.658014 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.662823 (+ 4809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:58.662828 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:58.662832 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:58.662869 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:58.666604 (+ 3735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:58.667815 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:58.667823 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:58.667828 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:58.668005 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:58.668750 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:58.668754 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:58.668758 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:58.669185 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:58.669392 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:58.670504 (+ 1112us) server_negotiation.cc:299] Negotiation successful
0809 06:52:58.670849 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 06:52:58.672230 19553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.647053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:36497 (local address 127.10.205.67:32805)
0809 06:52:58.647892 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:58.647951 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:58.650129 (+ 2178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:58.651022 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:58.651034 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:58.651854 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:58.652854 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.652896 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.654734 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.654741 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.657071 (+ 2330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.657091 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.658146 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.658154 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.658514 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.659417 (+ 903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:58.659449 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:58.662555 (+ 3106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:58.666813 (+ 4258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:58.666827 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:58.666850 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:58.667591 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:58.668191 (+ 600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:58.668196 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:58.668199 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:58.668570 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:58.669366 (+ 796us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:58.669374 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:58.669975 (+ 601us) client_negotiation.cc:769] Sending connection context
0809 06:52:58.670331 (+ 356us) client_negotiation.cc:240] Negotiation successful
0809 06:52:58.670840 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":381,"threads_started":1}
I20260809 06:52:58.690851 19527 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:37379
I20260809 06:52:58.690877 19671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:37379 every 8 connection(s)
I20260809 06:52:58.692221 19527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:52:58.694981 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.679651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:40451 (local address 127.10.205.126:36497)
0809 06:52:58.679886 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:58.679896 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:58.680585 (+ 689us) server_negotiation.cc:407] Connection header received
0809 06:52:58.680824 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:58.680830 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:58.680927 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:58.681042 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:58.682351 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.683392 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.685578 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.686003 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.686150 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.688995 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:58.689008 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:58.689013 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:58.689046 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:58.691922 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:58.692668 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:58.692673 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:58.692677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:58.692818 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:58.693350 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:58.693354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:58.693357 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:58.693719 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:58.693904 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:58.694378 (+ 474us) server_negotiation.cc:299] Negotiation successful
0809 06:52:58.694600 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 06:52:58.695003 19643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.679696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:36497 (local address 127.10.205.67:40451)
0809 06:52:58.680467 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:58.680498 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:58.680671 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:58.681244 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:58.681255 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:58.681745 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:58.682202 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.682213 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.683540 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.683548 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.685410 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.685423 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.686264 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.686271 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.686434 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.687223 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:58.687240 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:58.688784 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:58.692053 (+ 3269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:58.692059 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:58.692064 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:58.692546 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:58.692935 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:58.692940 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:58.692944 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:58.693183 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:58.693863 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:58.693868 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:58.694091 (+ 223us) client_negotiation.cc:769] Sending connection context
0809 06:52:58.694246 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 06:52:58.694568 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":364,"threads_started":1}
I20260809 06:52:58.695724 19673 heartbeater.cc:347] Connected to a master server at 127.10.205.126:36497
I20260809 06:52:58.695968 19673 heartbeater.cc:464] Registering TS with master...
I20260809 06:52:58.696828 19673 heartbeater.cc:511] Master 127.10.205.126:36497 requested a full tablet report, sending...
I20260809 06:52:58.698490 19147 ts_manager.cc:194] Registered new tserver with Master: 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379)
I20260809 06:52:58.699059 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 19527
I20260809 06:52:58.699267 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:52:58.699556 19147 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:32805
I20260809 06:52:58.699752 11061 external_mini_cluster.cc:1428] Setting key ac4e8aab45b29f6da37c7a407d8c4db7
I20260809 06:52:58.702652 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 06:52:58 dist-test-slave-0b58 krb5kdc[19099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258378, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 06:52:58 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:52:58 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 06:52:58.763335 19249 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:52:58.751705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35448 (local address 127.10.205.126:36497)
0809 06:52:58.751985 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:58.751992 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:58.752210 (+ 218us) server_negotiation.cc:407] Connection header received
0809 06:52:58.752505 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:58.752510 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:58.752579 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:58.752695 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:58.754192 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.755031 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.756480 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.756961 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.757102 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.763097 (+ 5995us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35448: BlockingRecv error: recv got EOF from 127.0.0.1:35448 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 09 06:52:58 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258378, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:58.780210 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.766342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35450 (local address 127.10.205.126:36497)
0809 06:52:58.766541 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:58.766550 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:58.766879 (+ 329us) server_negotiation.cc:407] Connection header received
0809 06:52:58.767081 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:58.767086 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:58.767159 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:58.767262 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:58.768541 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.769270 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.770519 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.770929 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.771055 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.775165 (+ 4110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:58.775170 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:58.775173 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:58.775227 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:58.777766 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:58.778491 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:58.778495 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:58.778497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:58.778624 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:58.779059 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:58.779063 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:58.779065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:58.779331 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:58.779566 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:58.779801 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 06:52:58.779977 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:52:58.784356 19147 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35450:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:52:58.791245 19147 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:58.823572 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.804652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35456 (local address 127.10.205.65:32983)
0809 06:52:58.814199 (+ 9547us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:58.814210 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:58.814510 (+ 300us) server_negotiation.cc:407] Connection header received
0809 06:52:58.814965 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:58.814978 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:58.815256 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:58.815467 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:58.816508 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.817876 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.820210 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.821720 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.821858 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.822142 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:58.823099 (+ 957us) server_negotiation.cc:299] Negotiation successful
0809 06:52:58.823265 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9166,"thread_start_us":8842,"threads_started":1}
I20260809 06:52:58.823786 19694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.804096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:32983 (local address 127.0.0.1:35456)
0809 06:52:58.814204 (+ 10108us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:58.814222 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:58.814378 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:58.815711 (+ 1333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:58.815717 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:58.815744 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:58.816341 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.816355 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.818040 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.818048 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.820023 (+ 1975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.820039 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.822343 (+ 2304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.822349 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.822728 (+ 379us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.822877 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 06:52:58.823014 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 06:52:58.823302 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9960,"mutex_wait_us":212,"thread_start_us":9813,"threads_started":1}
I20260809 06:52:58.823815 19692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.803542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37379 (local address 127.0.0.1:58208)
0809 06:52:58.810597 (+ 7055us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:58.810660 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:58.810871 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:58.815587 (+ 4716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:58.815596 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:58.815623 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:58.816234 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.816254 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.818311 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.818316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.820391 (+ 2075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.820406 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.822294 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.822303 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.822728 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.822877 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 06:52:58.823003 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 06:52:58.823301 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":272,"thread_start_us":489,"threads_started":1}
I20260809 06:52:58.824671 19693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.803719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58208 (local address 127.10.205.67:37379)
0809 06:52:58.815006 (+ 11287us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:58.815014 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:58.815045 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:52:58.815131 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:58.815137 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:58.815330 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:58.816116 (+ 786us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:58.816530 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.818139 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.820579 (+ 2440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.822047 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.822198 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.822473 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:58.824112 (+ 1639us) server_negotiation.cc:299] Negotiation successful
0809 06:52:58.824337 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11119,"thread_start_us":10927,"threads_started":1}
I20260809 06:52:58.826202 19697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.805542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33368 (local address 127.10.205.66:40765)
0809 06:52:58.815607 (+ 10065us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:58.815619 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:58.816468 (+ 849us) server_negotiation.cc:407] Connection header received
0809 06:52:58.816581 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:58.816588 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:58.816820 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:58.817038 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:58.817853 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.819273 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.822432 (+ 3159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.823507 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.823644 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.823848 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:58.825698 (+ 1850us) server_negotiation.cc:299] Negotiation successful
0809 06:52:58.825882 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9887,"thread_start_us":9748,"threads_started":1}
I20260809 06:52:58.826577 19696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:58.804935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:40765 (local address 127.0.0.1:33368)
0809 06:52:58.816131 (+ 11196us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:58.816149 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:58.816321 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:58.817025 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:58.817030 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:58.817054 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:58.817412 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.817423 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.819462 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.819468 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.822227 (+ 2759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:58.822242 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:58.824004 (+ 1762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:58.824011 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:58.824192 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:58.824243 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 06:52:58.824346 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 06:52:58.824485 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11067,"mutex_wait_us":21,"thread_start_us":10915,"threads_started":1}
I20260809 06:52:58.828469 19296 tablet_service.cc:1467] Processing CreateTablet for tablet 83888ac925fd475d9f3cd0c8db03af7f (DEFAULT_TABLE table=test-table [id=14ae9aaf309c4ea9b9bf0a6386539940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:58.828462 19600 tablet_service.cc:1467] Processing CreateTablet for tablet 83888ac925fd475d9f3cd0c8db03af7f (DEFAULT_TABLE table=test-table [id=14ae9aaf309c4ea9b9bf0a6386539940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:58.829859 19296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83888ac925fd475d9f3cd0c8db03af7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:58.829952 19600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83888ac925fd475d9f3cd0c8db03af7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:58.830129 19448 tablet_service.cc:1467] Processing CreateTablet for tablet 83888ac925fd475d9f3cd0c8db03af7f (DEFAULT_TABLE table=test-table [id=14ae9aaf309c4ea9b9bf0a6386539940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:58.831408 19448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83888ac925fd475d9f3cd0c8db03af7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:58.841198 19698 tablet_bootstrap.cc:492] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b: Bootstrap starting.
I20260809 06:52:58.844481 19699 tablet_bootstrap.cc:492] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Bootstrap starting.
I20260809 06:52:58.845678 19698 tablet_bootstrap.cc:654] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:58.845945 19700 tablet_bootstrap.cc:492] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca: Bootstrap starting.
I20260809 06:52:58.847493 19698 log.cc:824] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:58.848169 19699 tablet_bootstrap.cc:654] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:58.848894 19700 tablet_bootstrap.cc:654] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:58.849319 19699 log.cc:824] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:58.850114 19700 log.cc:824] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca: Log is configured to *not* fsync() on all Append() calls
I20260809 06:52:58.851145 19698 tablet_bootstrap.cc:492] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b: No bootstrap required, opened a new log
I20260809 06:52:58.851495 19698 ts_tablet_manager.cc:1397] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260809 06:52:58.854642 19700 tablet_bootstrap.cc:492] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca: No bootstrap required, opened a new log
I20260809 06:52:58.854957 19700 ts_tablet_manager.cc:1397] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.002s
I20260809 06:52:58.855556 19699 tablet_bootstrap.cc:492] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625: No bootstrap required, opened a new log
I20260809 06:52:58.855813 19699 ts_tablet_manager.cc:1397] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260809 06:52:58.862423 19700 raft_consensus.cc:348] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } }
I20260809 06:52:58.862455 19698 raft_consensus.cc:348] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } }
I20260809 06:52:58.862824 19700 raft_consensus.cc:374] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:58.862912 19698 raft_consensus.cc:374] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:58.862939 19700 raft_consensus.cc:729] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 720d22b98b714aafa6272082084d56ca, State: Initialized, Role: FOLLOWER
I20260809 06:52:58.863054 19698 raft_consensus.cc:729] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03572e22c494ba7b7c9015b8c5dc36b, State: Initialized, Role: FOLLOWER
I20260809 06:52:58.863690 19700 consensus_queue.cc:260] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } }
I20260809 06:52:58.863703 19698 consensus_queue.cc:260] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } }
I20260809 06:52:58.864874 19523 heartbeater.cc:503] Master 127.10.205.126:36497 was elected leader, sending a full tablet report...
I20260809 06:52:58.865442 19700 ts_tablet_manager.cc:1428] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca: Time spent starting tablet: real 0.010s user 0.004s sys 0.007s
I20260809 06:52:58.866441 19699 raft_consensus.cc:348] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } }
I20260809 06:52:58.866858 19699 raft_consensus.cc:374] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:58.866966 19699 raft_consensus.cc:729] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c9a7cfd3f06462dbbae4b9dd9ba8625, State: Initialized, Role: FOLLOWER
I20260809 06:52:58.867269 19698 ts_tablet_manager.cc:1428] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b: Time spent starting tablet: real 0.016s user 0.010s sys 0.006s
I20260809 06:52:58.867573 19699 consensus_queue.cc:260] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } }
I20260809 06:52:58.868687 19673 heartbeater.cc:503] Master 127.10.205.126:36497 was elected leader, sending a full tablet report...
I20260809 06:52:58.869751 19699 ts_tablet_manager.cc:1428] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Time spent starting tablet: real 0.014s user 0.013s sys 0.002s
W20260809 06:52:58.904438 19524 tablet.cc:2369] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:52:58.944100 19674 tablet.cc:2369] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:52:59.065636 19704 raft_consensus.cc:482] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:59.065958 19704 raft_consensus.cc:504] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } }
I20260809 06:52:59.067613 19704 leader_election.cc:288] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379), d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983)
I20260809 06:52:59.074331 19693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.068244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:49713 (local address 127.10.205.67:37379)
0809 06:52:59.068476 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.068482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.068989 (+ 507us) server_negotiation.cc:407] Connection header received
0809 06:52:59.069187 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.069191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.069253 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.069357 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:59.070006 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.070727 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.072543 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.073304 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.073491 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.073572 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.073918 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.074066 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260809 06:52:59.074496 19708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.068079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37379 (local address 127.10.205.66:49713)
0809 06:52:59.068854 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:59.068873 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:59.069009 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:59.069389 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:59.069394 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:59.069425 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:59.069849 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.069859 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.070867 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.070875 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.072372 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.072385 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.073533 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.073540 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.073744 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.073770 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 06:52:59.073878 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 06:52:59.074014 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":1,"thread_start_us":371,"threads_started":1}
I20260809 06:52:59.074819 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.068227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:52247 (local address 127.10.205.65:32983)
0809 06:52:59.068476 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.068482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.069646 (+ 1164us) server_negotiation.cc:407] Connection header received
0809 06:52:59.069887 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.069892 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.069967 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.070067 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:59.070586 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.071275 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.073099 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.073870 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.074068 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.074139 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.074432 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.074588 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260809 06:52:59.075253 19709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.068807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:32983 (local address 127.10.205.66:52247)
0809 06:52:59.069533 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:59.069547 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:59.069709 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:59.070084 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:59.070088 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:59.070111 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:59.070432 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.070440 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.071432 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.071437 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.072941 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.072954 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.074100 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.074106 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.074274 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.074299 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 06:52:59.074403 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 06:52:59.075003 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":423,"threads_started":1}
I20260809 06:52:59.075811 19620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83888ac925fd475d9f3cd0c8db03af7f" candidate_uuid: "720d22b98b714aafa6272082084d56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" is_pre_election: true
I20260809 06:52:59.076454 19620 raft_consensus.cc:2454] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 720d22b98b714aafa6272082084d56ca in term 0.
I20260809 06:52:59.076773 19317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83888ac925fd475d9f3cd0c8db03af7f" candidate_uuid: "720d22b98b714aafa6272082084d56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" is_pre_election: true
I20260809 06:52:59.077163 19394 leader_election.cc:302] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c9a7cfd3f06462dbbae4b9dd9ba8625, 720d22b98b714aafa6272082084d56ca; no voters:
I20260809 06:52:59.077333 19317 raft_consensus.cc:2454] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 720d22b98b714aafa6272082084d56ca in term 0.
I20260809 06:52:59.077636 19704 raft_consensus.cc:2781] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:59.077800 19704 raft_consensus.cc:482] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:59.077935 19704 raft_consensus.cc:3037] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:59.080353 19704 raft_consensus.cc:504] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } }
I20260809 06:52:59.081010 19704 leader_election.cc:288] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [CANDIDATE]: Term 1 election: Requested vote from peers 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379), d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983)
I20260809 06:52:59.081533 19317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83888ac925fd475d9f3cd0c8db03af7f" candidate_uuid: "720d22b98b714aafa6272082084d56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03572e22c494ba7b7c9015b8c5dc36b"
I20260809 06:52:59.081532 19620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83888ac925fd475d9f3cd0c8db03af7f" candidate_uuid: "720d22b98b714aafa6272082084d56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625"
I20260809 06:52:59.081748 19620 raft_consensus.cc:3037] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:59.081748 19317 raft_consensus.cc:3037] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:59.085031 19317 raft_consensus.cc:2454] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 720d22b98b714aafa6272082084d56ca in term 1.
I20260809 06:52:59.085032 19620 raft_consensus.cc:2454] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 720d22b98b714aafa6272082084d56ca in term 1.
I20260809 06:52:59.085429 19394 leader_election.cc:302] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c9a7cfd3f06462dbbae4b9dd9ba8625, 720d22b98b714aafa6272082084d56ca; no voters:
I20260809 06:52:59.085842 19704 raft_consensus.cc:2781] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:59.086580 19704 raft_consensus.cc:686] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 1 LEADER]: Becoming Leader. State: Replica: 720d22b98b714aafa6272082084d56ca, State: Running, Role: LEADER
I20260809 06:52:59.087145 19704 consensus_queue.cc:237] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } }
I20260809 06:52:59.091707 19147 catalog_manager.cc:5495] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 720d22b98b714aafa6272082084d56ca (127.10.205.66). New cstate: current_term: 1 leader_uuid: "720d22b98b714aafa6272082084d56ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } health_report { overall_health: UNKNOWN } } }
W20260809 06:52:59.102090 19371 tablet.cc:2369] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:52:59.126888 19697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.121650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33370 (local address 127.10.205.66:40765)
0809 06:52:59.121898 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.121903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.122086 (+ 183us) server_negotiation.cc:407] Connection header received
0809 06:52:59.122331 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.122335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.122423 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.122548 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:59.122878 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.123595 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.124937 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.125346 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.125452 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.125852 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:59.126410 (+ 558us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:59.126517 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.126606 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.126672 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:52:59.135565 19317 raft_consensus.cc:1261] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Refusing update from remote peer 720d22b98b714aafa6272082084d56ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:59.135566 19620 raft_consensus.cc:1261] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Refusing update from remote peer 720d22b98b714aafa6272082084d56ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:59.136639 19710 consensus_queue.cc:1035] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:59.136994 19704 consensus_queue.cc:1035] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:59.182700 19147 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:59.183007 19147 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:59.186465 19147 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795: Sending DeleteTablet for 3 replicas of tablet 83888ac925fd475d9f3cd0c8db03af7f
I20260809 06:52:59.187736 19600 tablet_service.cc:1514] Processing DeleteTablet for tablet 83888ac925fd475d9f3cd0c8db03af7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:59 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:58208
I20260809 06:52:59.187876 19448 tablet_service.cc:1514] Processing DeleteTablet for tablet 83888ac925fd475d9f3cd0c8db03af7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:59 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:33368
I20260809 06:52:59.188198 19296 tablet_service.cc:1514] Processing DeleteTablet for tablet 83888ac925fd475d9f3cd0c8db03af7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:59 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:35456
I20260809 06:52:59.188689 19147 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35450:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:52:59.189857 19147 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:59.200557 19295 tablet_service.cc:1467] Processing CreateTablet for tablet e57f9ec0f1a4431783e2e9c18feb769c (DEFAULT_TABLE table=test-table [id=20c29efd4e904c38baf039c1ea2ae966]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:59.201375 19295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e57f9ec0f1a4431783e2e9c18feb769c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:59.204509 19727 tablet_replica.cc:330] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625: stopping tablet replica
I20260809 06:52:59.204797 19447 tablet_service.cc:1467] Processing CreateTablet for tablet e57f9ec0f1a4431783e2e9c18feb769c (DEFAULT_TABLE table=test-table [id=20c29efd4e904c38baf039c1ea2ae966]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:59.205120 19727 raft_consensus.cc:2229] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:59.205557 19447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e57f9ec0f1a4431783e2e9c18feb769c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:59.205699 19727 raft_consensus.cc:2258] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:59.206547 19726 tablet_replica.cc:330] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca: stopping tablet replica
I20260809 06:52:59.206991 19726 raft_consensus.cc:2229] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:59.208086 19599 tablet_service.cc:1467] Processing CreateTablet for tablet e57f9ec0f1a4431783e2e9c18feb769c (DEFAULT_TABLE table=test-table [id=20c29efd4e904c38baf039c1ea2ae966]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:59.208642 19599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e57f9ec0f1a4431783e2e9c18feb769c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:59.213191 19728 tablet_replica.cc:330] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b: stopping tablet replica
I20260809 06:52:59.213892 19698 tablet_bootstrap.cc:492] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b: Bootstrap starting.
I20260809 06:52:59.215633 19698 tablet_bootstrap.cc:654] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:59.217098 19728 raft_consensus.cc:2229] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:59.217660 19728 raft_consensus.cc:2258] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:59.218247 19726 raft_consensus.cc:2258] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:59.218924 19700 tablet_bootstrap.cc:492] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca: Bootstrap starting.
I20260809 06:52:59.219563 19698 tablet_bootstrap.cc:492] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b: No bootstrap required, opened a new log
I20260809 06:52:59.219696 19698 ts_tablet_manager.cc:1397] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260809 06:52:59.220525 19698 raft_consensus.cc:348] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.220741 19698 raft_consensus.cc:374] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:59.220768 19700 tablet_bootstrap.cc:654] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:59.220824 19698 raft_consensus.cc:729] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03572e22c494ba7b7c9015b8c5dc36b, State: Initialized, Role: FOLLOWER
I20260809 06:52:59.221213 19698 consensus_queue.cc:260] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.223147 19699 tablet_bootstrap.cc:492] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Bootstrap starting.
I20260809 06:52:59.224550 19726 ts_tablet_manager.cc:1905] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:59.225049 19699 tablet_bootstrap.cc:654] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:59.228524 19727 ts_tablet_manager.cc:1905] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:59.231400 19698 ts_tablet_manager.cc:1428] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260809 06:52:59.233330 19726 ts_tablet_manager.cc:1918] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:59.233527 19726 log.cc:1196] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/83888ac925fd475d9f3cd0c8db03af7f
I20260809 06:52:59.234109 19726 ts_tablet_manager.cc:1939] T 83888ac925fd475d9f3cd0c8db03af7f P 720d22b98b714aafa6272082084d56ca: Deleting consensus metadata
I20260809 06:52:59.236109 19133 catalog_manager.cc:4841] TS 720d22b98b714aafa6272082084d56ca (127.10.205.66:40765): tablet 83888ac925fd475d9f3cd0c8db03af7f (table test-table [id=14ae9aaf309c4ea9b9bf0a6386539940]) successfully deleted
I20260809 06:52:59.226773 19728 ts_tablet_manager.cc:1905] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:59.237628 19700 tablet_bootstrap.cc:492] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca: No bootstrap required, opened a new log
I20260809 06:52:59.237819 19700 ts_tablet_manager.cc:1397] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.003s
I20260809 06:52:59.238070 19699 tablet_bootstrap.cc:492] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625: No bootstrap required, opened a new log
I20260809 06:52:59.238227 19699 ts_tablet_manager.cc:1397] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.003s
I20260809 06:52:59.238739 19700 raft_consensus.cc:348] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.239015 19700 raft_consensus.cc:374] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:59.239137 19700 raft_consensus.cc:729] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 720d22b98b714aafa6272082084d56ca, State: Initialized, Role: FOLLOWER
I20260809 06:52:59.239051 19699 raft_consensus.cc:348] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.239289 19699 raft_consensus.cc:374] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:59.239404 19699 raft_consensus.cc:729] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c9a7cfd3f06462dbbae4b9dd9ba8625, State: Initialized, Role: FOLLOWER
I20260809 06:52:59.239463 19700 consensus_queue.cc:260] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.239708 19699 consensus_queue.cc:260] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.241629 19700 ts_tablet_manager.cc:1428] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260809 06:52:59.244066 19727 ts_tablet_manager.cc:1918] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:59.244251 19727 log.cc:1196] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/83888ac925fd475d9f3cd0c8db03af7f
I20260809 06:52:59.244872 19727 ts_tablet_manager.cc:1939] T 83888ac925fd475d9f3cd0c8db03af7f P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Deleting consensus metadata
I20260809 06:52:59.245519 19699 ts_tablet_manager.cc:1428] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260809 06:52:59.246631 19728 ts_tablet_manager.cc:1918] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:52:59.246819 19728 log.cc:1196] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/83888ac925fd475d9f3cd0c8db03af7f
I20260809 06:52:59.247396 19728 ts_tablet_manager.cc:1939] T 83888ac925fd475d9f3cd0c8db03af7f P d03572e22c494ba7b7c9015b8c5dc36b: Deleting consensus metadata
I20260809 06:52:59.247658 19133 catalog_manager.cc:4841] TS 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379): tablet 83888ac925fd475d9f3cd0c8db03af7f (table test-table [id=14ae9aaf309c4ea9b9bf0a6386539940]) successfully deleted
I20260809 06:52:59.249353 19132 catalog_manager.cc:4841] TS d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983): tablet 83888ac925fd475d9f3cd0c8db03af7f (table test-table [id=14ae9aaf309c4ea9b9bf0a6386539940]) successfully deleted
I20260809 06:52:59.334373 19706 raft_consensus.cc:482] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:59.334658 19706 raft_consensus.cc:504] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.336328 19706 leader_election.cc:288] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983), 720d22b98b714aafa6272082084d56ca (127.10.205.66:40765)
I20260809 06:52:59.344750 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.337207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:39745 (local address 127.10.205.65:32983)
0809 06:52:59.337397 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.337403 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.338270 (+ 867us) server_negotiation.cc:407] Connection header received
0809 06:52:59.338523 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.338530 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.338632 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.338750 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:59.339437 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.340481 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.342626 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.343737 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.343917 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.344011 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.344308 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.344441 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:52:59.344853 19732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.336733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:32983 (local address 127.10.205.67:39745)
0809 06:52:59.338129 (+ 1396us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:59.338153 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:59.338309 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:59.338782 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:59.338786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:59.338820 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:59.339251 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.339262 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.340614 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.340622 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.342432 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.342446 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.343918 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.343924 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.344113 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.344137 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:52:59.344275 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 06:52:59.344415 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1281,"mutex_wait_us":43,"thread_start_us":743,"threads_started":1}
I20260809 06:52:59.345592 19317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57f9ec0f1a4431783e2e9c18feb769c" candidate_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" is_pre_election: true
I20260809 06:52:59.345816 19697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.336787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:35243 (local address 127.10.205.66:40765)
0809 06:52:59.337037 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.337046 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.337717 (+ 671us) server_negotiation.cc:407] Connection header received
0809 06:52:59.338103 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.338107 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.338170 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.338278 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:59.339005 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.340130 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.342866 (+ 2736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.344197 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.344416 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.344489 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.345424 (+ 935us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.345544 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 06:52:59.345899 19317 raft_consensus.cc:2454] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c9a7cfd3f06462dbbae4b9dd9ba8625 in term 0.
I20260809 06:52:59.346439 19546 leader_election.cc:302] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c9a7cfd3f06462dbbae4b9dd9ba8625, d03572e22c494ba7b7c9015b8c5dc36b; no voters:
I20260809 06:52:59.346765 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.336641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:40765 (local address 127.10.205.67:35243)
0809 06:52:59.337576 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:59.337602 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:59.337870 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:59.338368 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:59.338373 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:59.338401 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:59.338752 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.338765 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.340325 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.340331 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.342659 (+ 2328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.342675 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.344659 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.344665 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.345225 (+ 560us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.345262 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 06:52:59.346142 (+ 880us) client_negotiation.cc:240] Negotiation successful
0809 06:52:59.346305 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"mutex_wait_us":9,"thread_start_us":1168,"threads_started":1}
I20260809 06:52:59.346896 19706 raft_consensus.cc:2781] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:59.346992 19706 raft_consensus.cc:482] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:59.347091 19706 raft_consensus.cc:3037] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:59.347793 19471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57f9ec0f1a4431783e2e9c18feb769c" candidate_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "720d22b98b714aafa6272082084d56ca" is_pre_election: true
I20260809 06:52:59.348300 19471 raft_consensus.cc:2454] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c9a7cfd3f06462dbbae4b9dd9ba8625 in term 0.
I20260809 06:52:59.349697 19706 raft_consensus.cc:504] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.350392 19706 leader_election.cc:288] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [CANDIDATE]: Term 1 election: Requested vote from peers d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983), 720d22b98b714aafa6272082084d56ca (127.10.205.66:40765)
I20260809 06:52:59.350839 19317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57f9ec0f1a4431783e2e9c18feb769c" candidate_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03572e22c494ba7b7c9015b8c5dc36b"
I20260809 06:52:59.350991 19471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e57f9ec0f1a4431783e2e9c18feb769c" candidate_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "720d22b98b714aafa6272082084d56ca"
I20260809 06:52:59.351078 19317 raft_consensus.cc:3037] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:59.351207 19471 raft_consensus.cc:3037] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:59.354316 19317 raft_consensus.cc:2454] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c9a7cfd3f06462dbbae4b9dd9ba8625 in term 1.
I20260809 06:52:59.354688 19471 raft_consensus.cc:2454] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c9a7cfd3f06462dbbae4b9dd9ba8625 in term 1.
I20260809 06:52:59.354858 19546 leader_election.cc:302] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c9a7cfd3f06462dbbae4b9dd9ba8625, d03572e22c494ba7b7c9015b8c5dc36b; no voters:
I20260809 06:52:59.355233 19706 raft_consensus.cc:2781] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:59.355784 19706 raft_consensus.cc:686] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 LEADER]: Becoming Leader. State: Replica: 3c9a7cfd3f06462dbbae4b9dd9ba8625, State: Running, Role: LEADER
I20260809 06:52:59.356168 19706 consensus_queue.cc:237] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.360044 19146 catalog_manager.cc:5495] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67). New cstate: current_term: 1 leader_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } health_report { overall_health: HEALTHY } } }
Aug 09 06:52:59 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258376, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.126@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:59.417059 19743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.402868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35464 (local address 127.10.205.126:36497)
0809 06:52:59.403864 (+ 996us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.403871 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.403898 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:52:59.403936 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.403939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.403997 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.404106 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:59.405189 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.406096 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.407429 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.407863 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.408002 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.411407 (+ 3405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:59.411412 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:59.411415 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:59.411444 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:59.414248 (+ 2804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:59.414979 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:59.414984 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:59.414994 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:59.415107 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:59.415491 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:59.415498 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:59.415501 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:59.415844 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:59.416007 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.416426 (+ 419us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.416643 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":865,"thread_start_us":704,"threads_started":1}
I20260809 06:52:59.417176 19742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.402780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:36497 (local address 127.0.0.1:35464)
0809 06:52:59.403554 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:59.403578 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:59.403763 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:59.404139 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:59.404145 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:59.404829 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:52:59.405026 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.405035 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.406278 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.406282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.407286 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.407299 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.408029 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.408034 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.408207 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.409006 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:52:59.409024 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:52:59.411208 (+ 2184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:52:59.414373 (+ 3165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:59.414387 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:59.414394 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:59.414867 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:59.415219 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:52:59.415224 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:52:59.415227 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:52:59.415390 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:52:59.415978 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:52:59.415985 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:52:59.416150 (+ 165us) client_negotiation.cc:769] Sending connection context
0809 06:52:59.416349 (+ 199us) client_negotiation.cc:240] Negotiation successful
0809 06:52:59.416765 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"mutex_wait_us":146,"thread_start_us":435,"threads_started":1}
I20260809 06:52:59.423161 19146 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:35464:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 06:52:59.424243 19146 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:59.432104 19295 tablet_service.cc:1467] Processing CreateTablet for tablet e4df9a2990c84fc2a2e50edb6289a6b3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=65911b4e8c4743d5b1d6e53008344725]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:52:59.432384 19447 tablet_service.cc:1467] Processing CreateTablet for tablet e4df9a2990c84fc2a2e50edb6289a6b3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=65911b4e8c4743d5b1d6e53008344725]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:52:59.432716 19295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4df9a2990c84fc2a2e50edb6289a6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:59.432962 19447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4df9a2990c84fc2a2e50edb6289a6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:59.437107 19599 tablet_service.cc:1467] Processing CreateTablet for tablet e4df9a2990c84fc2a2e50edb6289a6b3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=65911b4e8c4743d5b1d6e53008344725]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:52:59.437661 19599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4df9a2990c84fc2a2e50edb6289a6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:59.439114 19698 tablet_bootstrap.cc:492] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b: Bootstrap starting.
I20260809 06:52:59.440959 19698 tablet_bootstrap.cc:654] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:59.443321 19698 tablet_bootstrap.cc:492] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b: No bootstrap required, opened a new log
I20260809 06:52:59.443496 19698 ts_tablet_manager.cc:1397] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 06:52:59.444013 19699 tablet_bootstrap.cc:492] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Bootstrap starting.
I20260809 06:52:59.444268 19698 raft_consensus.cc:348] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.444573 19698 raft_consensus.cc:374] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:59.444658 19698 raft_consensus.cc:729] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03572e22c494ba7b7c9015b8c5dc36b, State: Initialized, Role: FOLLOWER
I20260809 06:52:59.444903 19698 consensus_queue.cc:260] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.445406 19705 tablet_replica.cc:439] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } }
I20260809 06:52:59.445780 19699 tablet_bootstrap.cc:654] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:59.445797 19705 tablet_replica.cc:442] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:59.446887 19698 ts_tablet_manager.cc:1428] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 06:52:59.448709 19700 tablet_bootstrap.cc:492] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: Bootstrap starting.
I20260809 06:52:59.450480 19700 tablet_bootstrap.cc:654] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:59.453203 19700 tablet_bootstrap.cc:492] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: No bootstrap required, opened a new log
I20260809 06:52:59.453389 19700 ts_tablet_manager.cc:1397] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260809 06:52:59.454218 19700 raft_consensus.cc:348] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.454484 19700 raft_consensus.cc:374] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:59.454562 19700 raft_consensus.cc:729] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 720d22b98b714aafa6272082084d56ca, State: Initialized, Role: FOLLOWER
I20260809 06:52:59.454810 19700 consensus_queue.cc:260] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.455457 19700 ts_tablet_manager.cc:1428] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 06:52:59.455832 19710 tablet_replica.cc:439] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } }
I20260809 06:52:59.456182 19710 tablet_replica.cc:442] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:59.457610 19699 tablet_bootstrap.cc:492] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: No bootstrap required, opened a new log
I20260809 06:52:59.457799 19699 ts_tablet_manager.cc:1397] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.002s
I20260809 06:52:59.458632 19699 raft_consensus.cc:348] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.458904 19699 raft_consensus.cc:374] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:59.459007 19699 raft_consensus.cc:729] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c9a7cfd3f06462dbbae4b9dd9ba8625, State: Initialized, Role: FOLLOWER
I20260809 06:52:59.459254 19699 consensus_queue.cc:260] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.459713 19706 tablet_replica.cc:439] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } }
I20260809 06:52:59.460041 19706 tablet_replica.cc:442] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:59.460275 19699 ts_tablet_manager.cc:1428] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260809 06:52:59.493600 19710 raft_consensus.cc:482] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:59.493876 19710 raft_consensus.cc:504] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.494530 19710 leader_election.cc:288] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983), 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379)
I20260809 06:52:59.495163 19317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4df9a2990c84fc2a2e50edb6289a6b3" candidate_uuid: "720d22b98b714aafa6272082084d56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" is_pre_election: true
I20260809 06:52:59.495183 19620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4df9a2990c84fc2a2e50edb6289a6b3" candidate_uuid: "720d22b98b714aafa6272082084d56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" is_pre_election: true
I20260809 06:52:59.495575 19620 raft_consensus.cc:2454] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 720d22b98b714aafa6272082084d56ca in term 0.
I20260809 06:52:59.495608 19317 raft_consensus.cc:2454] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 720d22b98b714aafa6272082084d56ca in term 0.
I20260809 06:52:59.496088 19394 leader_election.cc:302] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c9a7cfd3f06462dbbae4b9dd9ba8625, 720d22b98b714aafa6272082084d56ca; no voters:
I20260809 06:52:59.496492 19710 raft_consensus.cc:2781] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:59.496618 19710 raft_consensus.cc:482] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:59.496785 19710 raft_consensus.cc:3037] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:59.500118 19710 raft_consensus.cc:504] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.500886 19710 leader_election.cc:288] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [CANDIDATE]: Term 1 election: Requested vote from peers d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983), 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379)
I20260809 06:52:59.501381 19620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4df9a2990c84fc2a2e50edb6289a6b3" candidate_uuid: "720d22b98b714aafa6272082084d56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625"
I20260809 06:52:59.501400 19317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4df9a2990c84fc2a2e50edb6289a6b3" candidate_uuid: "720d22b98b714aafa6272082084d56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03572e22c494ba7b7c9015b8c5dc36b"
I20260809 06:52:59.501603 19620 raft_consensus.cc:3037] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:59.501652 19317 raft_consensus.cc:3037] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:59.503684 19620 raft_consensus.cc:2454] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 720d22b98b714aafa6272082084d56ca in term 1.
I20260809 06:52:59.504143 19394 leader_election.cc:302] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c9a7cfd3f06462dbbae4b9dd9ba8625, 720d22b98b714aafa6272082084d56ca; no voters:
I20260809 06:52:59.504447 19710 raft_consensus.cc:2781] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:59.504663 19710 raft_consensus.cc:686] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [term 1 LEADER]: Becoming Leader. State: Replica: 720d22b98b714aafa6272082084d56ca, State: Running, Role: LEADER
I20260809 06:52:59.504755 19317 raft_consensus.cc:2454] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 720d22b98b714aafa6272082084d56ca in term 1.
I20260809 06:52:59.505343 19710 consensus_queue.cc:237] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.507927 19704 tablet_replica.cc:439] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: TxnStatusTablet state changed. Reason: New leader 720d22b98b714aafa6272082084d56ca. Latest consensus state: current_term: 1 leader_uuid: "720d22b98b714aafa6272082084d56ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } }
I20260809 06:52:59.508188 19704 tablet_replica.cc:442] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:52:59.508975 19145 catalog_manager.cc:5495] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 720d22b98b714aafa6272082084d56ca (127.10.205.66). New cstate: current_term: 1 leader_uuid: "720d22b98b714aafa6272082084d56ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260809 06:52:59.514686 19748 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 06:52:59.514952 19748 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 06:52:59.535921 19742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.529927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:40765 (local address 127.0.0.1:33378)
0809 06:52:59.530173 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:59.530198 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:59.530349 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:59.530813 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:59.530816 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:59.530826 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:52:59.531044 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.531052 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.532527 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.532531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.533759 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.533773 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.534824 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.534829 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.534965 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.535022 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:52:59.535481 (+ 459us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:52:59.535496 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 06:52:59.535556 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 06:52:59.535677 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 06:52:59.535984 19697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.529971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33378 (local address 127.10.205.66:40765)
0809 06:52:59.530192 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.530198 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.530248 (+ 50us) server_negotiation.cc:407] Connection header received
0809 06:52:59.530562 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.530568 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.530656 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.530757 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:59.531176 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.532391 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.533923 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.534661 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.534807 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.535211 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:59.535360 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:59.535477 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.535616 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.535705 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 06:52:59.539717 19317 raft_consensus.cc:1261] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Refusing update from remote peer 720d22b98b714aafa6272082084d56ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:59.539783 19620 raft_consensus.cc:1261] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Refusing update from remote peer 720d22b98b714aafa6272082084d56ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:59.540431 19704 consensus_queue.cc:1035] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:59.541059 19710 consensus_queue.cc:1035] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:59.543923 19706 tablet_replica.cc:439] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: TxnStatusTablet state changed. Reason: New leader 720d22b98b714aafa6272082084d56ca. Latest consensus state: current_term: 1 leader_uuid: "720d22b98b714aafa6272082084d56ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } }
I20260809 06:52:59.544042 19705 tablet_replica.cc:439] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b: TxnStatusTablet state changed. Reason: New leader 720d22b98b714aafa6272082084d56ca. Latest consensus state: current_term: 1 leader_uuid: "720d22b98b714aafa6272082084d56ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } }
I20260809 06:52:59.544305 19706 tablet_replica.cc:442] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:59.544351 19705 tablet_replica.cc:442] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:59.548313 19710 tablet_replica.cc:439] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "720d22b98b714aafa6272082084d56ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } }
I20260809 06:52:59.548614 19710 tablet_replica.cc:442] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:52:59.548866 19715 mvcc.cc:205] Tried to move back new op lower bound from 7316514322588364800 to 7316514322456711168. Current Snapshot: MvccSnapshot[applied={T|T < 7316514322588364800}]
I20260809 06:52:59.548959 19716 mvcc.cc:205] Tried to move back new op lower bound from 7316514322588364800 to 7316514322456711168. Current Snapshot: MvccSnapshot[applied={T|T < 7316514322588364800}]
I20260809 06:52:59.548920 19710 tablet_replica.cc:439] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "720d22b98b714aafa6272082084d56ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } }
I20260809 06:52:59.549140 19710 tablet_replica.cc:442] T e4df9a2990c84fc2a2e50edb6289a6b3 P 720d22b98b714aafa6272082084d56ca: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:52:59.549333 19713 mvcc.cc:205] Tried to move back new op lower bound from 7316514322588364800 to 7316514322456711168. Current Snapshot: MvccSnapshot[applied={T|T < 7316514322588364800 or (T in {7316514322588364800})}]
I20260809 06:52:59.550642 19706 tablet_replica.cc:439] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "720d22b98b714aafa6272082084d56ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } }
I20260809 06:52:59.550940 19706 tablet_replica.cc:442] T e4df9a2990c84fc2a2e50edb6289a6b3 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:59.550822 19705 tablet_replica.cc:439] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "720d22b98b714aafa6272082084d56ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } } }
I20260809 06:52:59.551045 19705 tablet_replica.cc:442] T e4df9a2990c84fc2a2e50edb6289a6b3 P d03572e22c494ba7b7c9015b8c5dc36b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:52:59.562776 19693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.556588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58218 (local address 127.10.205.67:37379)
0809 06:52:59.556781 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.556788 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.556816 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:52:59.557036 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.557042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.557151 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.557363 (+ 212us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:59.557697 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.558920 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.560200 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.560850 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.561031 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.561408 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:59.562146 (+ 738us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:59.562318 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.562368 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.562458 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:52:59.580726 19754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.573885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:40765 (local address 127.10.205.67:45343)
0809 06:52:59.574631 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:59.574648 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:59.574767 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:59.575333 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:59.575340 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:59.575355 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:52:59.575731 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.575748 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.577184 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.577188 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.578437 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.578450 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.579564 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.579569 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.579691 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.579751 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:52:59.580199 (+ 448us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:52:59.580207 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 06:52:59.580329 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 06:52:59.580434 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":420,"threads_started":1}
I20260809 06:52:59.580739 19697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.573897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:45343 (local address 127.10.205.66:40765)
0809 06:52:59.574123 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.574129 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.574742 (+ 613us) server_negotiation.cc:407] Connection header received
0809 06:52:59.575083 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.575091 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.575177 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.575331 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:59.575932 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.577039 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.578596 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.579396 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.579537 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.579945 (+ 408us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:59.580096 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:59.580194 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.580357 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.580459 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:52:59.591168 19471 raft_consensus.cc:1261] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Refusing update from remote peer 3c9a7cfd3f06462dbbae4b9dd9ba8625: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:59.591868 19317 raft_consensus.cc:1261] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Refusing update from remote peer 3c9a7cfd3f06462dbbae4b9dd9ba8625: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:59.592036 19734 consensus_queue.cc:1035] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [LEADER]: Connected to new peer: Peer: permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:59.592537 19706 consensus_queue.cc:1035] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:59.647190 19693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.640523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:45797 (local address 127.10.205.67:37379)
0809 06:52:59.640714 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.640718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.641442 (+ 724us) server_negotiation.cc:407] Connection header received
0809 06:52:59.641732 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.641739 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.641827 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.641920 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:59.642580 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.643505 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.645017 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.645667 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.645821 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.646424 (+ 603us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:59.646589 (+ 165us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:59.646687 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.646826 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.646911 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 06:52:59.647395 19759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.640554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37379 (local address 127.10.205.66:45797)
0809 06:52:59.641335 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:59.641362 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:59.641568 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:59.641949 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:59.641956 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:59.641971 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:52:59.642404 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.642414 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.643640 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.643647 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.644875 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.644888 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.645888 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.645900 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.646102 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.646199 (+ 97us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:52:59.646690 (+ 491us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:52:59.646702 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 06:52:59.646795 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 06:52:59.646947 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":465,"threads_started":1}
I20260809 06:52:59.688930 19145 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:59.689218 19145 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:59.693246 19145 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795: Sending DeleteTablet for 3 replicas of tablet e57f9ec0f1a4431783e2e9c18feb769c
I20260809 06:52:59.694403 19599 tablet_service.cc:1514] Processing DeleteTablet for tablet e57f9ec0f1a4431783e2e9c18feb769c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:59 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:58208
I20260809 06:52:59.694721 19727 tablet_replica.cc:330] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625: stopping tablet replica
I20260809 06:52:59.694944 19727 raft_consensus.cc:2229] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:59.695063 19295 tablet_service.cc:1514] Processing DeleteTablet for tablet e57f9ec0f1a4431783e2e9c18feb769c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:59 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:35456
I20260809 06:52:59.695384 19728 tablet_replica.cc:330] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b: stopping tablet replica
I20260809 06:52:59.695542 19727 raft_consensus.cc:2258] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:59.695598 19728 raft_consensus.cc:2229] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:59.695801 19728 raft_consensus.cc:2258] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:59.695837 19447 tablet_service.cc:1514] Processing DeleteTablet for tablet e57f9ec0f1a4431783e2e9c18feb769c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:59 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:33368
I20260809 06:52:59.696233 19726 tablet_replica.cc:330] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca: stopping tablet replica
I20260809 06:52:59.696498 19726 raft_consensus.cc:2229] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:59.696714 19726 raft_consensus.cc:2258] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:59.697085 19728 ts_tablet_manager.cc:1905] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:59.697158 19727 ts_tablet_manager.cc:1905] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:59.702939 19726 ts_tablet_manager.cc:1905] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:59.704134 19728 ts_tablet_manager.cc:1918] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:52:59.704463 19728 log.cc:1196] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/e57f9ec0f1a4431783e2e9c18feb769c
I20260809 06:52:59.705022 19728 ts_tablet_manager.cc:1939] T e57f9ec0f1a4431783e2e9c18feb769c P d03572e22c494ba7b7c9015b8c5dc36b: Deleting consensus metadata
I20260809 06:52:59.708629 19132 catalog_manager.cc:4841] TS d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983): tablet e57f9ec0f1a4431783e2e9c18feb769c (table test-table [id=20c29efd4e904c38baf039c1ea2ae966]) successfully deleted
I20260809 06:52:59.718873 19726 ts_tablet_manager.cc:1918] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:52:59.719079 19726 log.cc:1196] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/e57f9ec0f1a4431783e2e9c18feb769c
I20260809 06:52:59.719533 19726 ts_tablet_manager.cc:1939] T e57f9ec0f1a4431783e2e9c18feb769c P 720d22b98b714aafa6272082084d56ca: Deleting consensus metadata
I20260809 06:52:59.720952 19133 catalog_manager.cc:4841] TS 720d22b98b714aafa6272082084d56ca (127.10.205.66:40765): tablet e57f9ec0f1a4431783e2e9c18feb769c (table test-table [id=20c29efd4e904c38baf039c1ea2ae966]) successfully deleted
I20260809 06:52:59.722518 19727 ts_tablet_manager.cc:1918] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:52:59.722730 19727 log.cc:1196] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/e57f9ec0f1a4431783e2e9c18feb769c
I20260809 06:52:59.723201 19727 ts_tablet_manager.cc:1939] T e57f9ec0f1a4431783e2e9c18feb769c P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Deleting consensus metadata
I20260809 06:52:59.724561 19133 catalog_manager.cc:4841] TS 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379): tablet e57f9ec0f1a4431783e2e9c18feb769c (table test-table [id=20c29efd4e904c38baf039c1ea2ae966]) successfully deleted
Aug 09 06:52:59 dist-test-slave-0b58 krb5kdc[19099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 06:52:59 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:52:59 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 06:52:59.797787 19743 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:52:59.786595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35476 (local address 127.10.205.126:36497)
0809 06:52:59.786777 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.786781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.787376 (+ 595us) server_negotiation.cc:407] Connection header received
0809 06:52:59.787603 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.787610 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.787703 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.787822 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:59.789744 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.790498 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.791800 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.792250 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.792425 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.797522 (+ 5097us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35476: BlockingRecv error: recv got EOF from 127.0.0.1:35476 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 06:52:59 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM
I20260809 06:52:59.816548 19743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.801056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35492 (local address 127.10.205.126:36497)
0809 06:52:59.801256 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.801262 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.802073 (+ 811us) server_negotiation.cc:407] Connection header received
0809 06:52:59.802266 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.802278 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.802348 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.802455 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:52:59.803644 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.804492 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.805822 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.806265 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.806424 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.810622 (+ 4198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:52:59.810627 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:52:59.810630 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:52:59.810668 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:52:59.813571 (+ 2903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:59.814357 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:59.814363 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:59.814367 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:59.814514 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:52:59.814976 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:52:59.814982 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:52:59.814985 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:52:59.815287 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:52:59.815576 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.815896 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.816137 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 06:52:59.820415 19145 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35492:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:52:59.821138 19145 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:59.828523 19295 tablet_service.cc:1467] Processing CreateTablet for tablet ee8d48b4d1eb491cbe58add4c65568e5 (DEFAULT_TABLE table=test-table [id=066f70883c694030a90d3461064a8427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:59.829108 19295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee8d48b4d1eb491cbe58add4c65568e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:59.829391 19447 tablet_service.cc:1467] Processing CreateTablet for tablet ee8d48b4d1eb491cbe58add4c65568e5 (DEFAULT_TABLE table=test-table [id=066f70883c694030a90d3461064a8427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:59.829886 19447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee8d48b4d1eb491cbe58add4c65568e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:59.832706 19599 tablet_service.cc:1467] Processing CreateTablet for tablet ee8d48b4d1eb491cbe58add4c65568e5 (DEFAULT_TABLE table=test-table [id=066f70883c694030a90d3461064a8427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:52:59.833204 19599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee8d48b4d1eb491cbe58add4c65568e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:52:59.836747 19698 tablet_bootstrap.cc:492] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b: Bootstrap starting.
I20260809 06:52:59.838459 19698 tablet_bootstrap.cc:654] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:59.846901 19700 tablet_bootstrap.cc:492] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca: Bootstrap starting.
I20260809 06:52:59.849220 19700 tablet_bootstrap.cc:654] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:59.851902 19698 tablet_bootstrap.cc:492] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b: No bootstrap required, opened a new log
I20260809 06:52:59.852103 19698 ts_tablet_manager.cc:1397] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.008s
I20260809 06:52:59.853549 19699 tablet_bootstrap.cc:492] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Bootstrap starting.
I20260809 06:52:59.854346 19698 raft_consensus.cc:348] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.854665 19698 raft_consensus.cc:374] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:59.854761 19698 raft_consensus.cc:729] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03572e22c494ba7b7c9015b8c5dc36b, State: Initialized, Role: FOLLOWER
I20260809 06:52:59.855057 19698 consensus_queue.cc:260] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.855535 19699 tablet_bootstrap.cc:654] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Neither blocks nor log segments found. Creating new log.
I20260809 06:52:59.860129 19698 ts_tablet_manager.cc:1428] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260809 06:52:59.861678 19699 tablet_bootstrap.cc:492] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: No bootstrap required, opened a new log
I20260809 06:52:59.861872 19699 ts_tablet_manager.cc:1397] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 06:52:59.862658 19699 raft_consensus.cc:348] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.862939 19699 raft_consensus.cc:374] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:59.863040 19699 raft_consensus.cc:729] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c9a7cfd3f06462dbbae4b9dd9ba8625, State: Initialized, Role: FOLLOWER
I20260809 06:52:59.863281 19699 consensus_queue.cc:260] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.864462 19699 ts_tablet_manager.cc:1428] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 06:52:59.866523 19700 tablet_bootstrap.cc:492] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca: No bootstrap required, opened a new log
I20260809 06:52:59.866707 19700 ts_tablet_manager.cc:1397] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.002s
I20260809 06:52:59.867619 19700 raft_consensus.cc:348] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.867964 19700 raft_consensus.cc:374] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:52:59.868106 19700 raft_consensus.cc:729] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 720d22b98b714aafa6272082084d56ca, State: Initialized, Role: FOLLOWER
I20260809 06:52:59.868418 19700 consensus_queue.cc:260] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.869484 19700 ts_tablet_manager.cc:1428] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 06:52:59.881073 19705 raft_consensus.cc:482] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:52:59.881347 19705 raft_consensus.cc:504] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.883008 19705 leader_election.cc:288] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 720d22b98b714aafa6272082084d56ca (127.10.205.66:40765), 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379)
I20260809 06:52:59.893422 19697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.883622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:34729 (local address 127.10.205.66:40765)
0809 06:52:59.883815 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.883823 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.883845 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:52:59.884100 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.884107 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.884197 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.884312 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:59.885063 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.886582 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.889799 (+ 3217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.891676 (+ 1877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.891871 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.891991 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.892763 (+ 772us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.892992 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:52:59.894440 19778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.883197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:40765 (local address 127.10.205.65:34729)
0809 06:52:59.883758 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:59.883779 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:59.883922 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:59.884582 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:59.884588 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:59.884635 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:59.884861 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.884874 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.886850 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.886859 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.889571 (+ 2712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.889593 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.892169 (+ 2576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.892179 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.892488 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.892548 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 06:52:59.893708 (+ 1160us) client_negotiation.cc:240] Negotiation successful
0809 06:52:59.893918 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":727,"threads_started":1}
I20260809 06:52:59.897317 19471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee8d48b4d1eb491cbe58add4c65568e5" candidate_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "720d22b98b714aafa6272082084d56ca" is_pre_election: true
I20260809 06:52:59.897650 19471 raft_consensus.cc:2454] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03572e22c494ba7b7c9015b8c5dc36b in term 0.
I20260809 06:52:59.898456 19242 leader_election.cc:302] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 720d22b98b714aafa6272082084d56ca, d03572e22c494ba7b7c9015b8c5dc36b; no voters:
I20260809 06:52:59.900406 19705 raft_consensus.cc:2781] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:52:59.900532 19705 raft_consensus.cc:482] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:52:59.900607 19705 raft_consensus.cc:3037] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:59.903152 19693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.885134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:47999 (local address 127.10.205.67:37379)
0809 06:52:59.885325 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.885332 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.894840 (+ 9508us) server_negotiation.cc:407] Connection header received
0809 06:52:59.895208 (+ 368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.895218 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.895342 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.895424 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:52:59.896446 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.897528 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.899930 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.901464 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.901615 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.901694 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.902679 (+ 985us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.902829 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 06:52:59.903952 19778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.884370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37379 (local address 127.10.205.65:47999)
0809 06:52:59.894694 (+ 10324us) negotiation.cc:107] Waiting for socket to connect
0809 06:52:59.894720 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 06:52:59.895007 (+ 287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:52:59.895679 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:52:59.895687 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:52:59.895724 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:52:59.896149 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.896168 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.897787 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.897792 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.899710 (+ 1918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:52:59.899726 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.902246 (+ 2520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.902257 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:52:59.902469 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.902510 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 06:52:59.903402 (+ 892us) client_negotiation.cc:240] Negotiation successful
0809 06:52:59.903560 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10213,"thread_start_us":12221,"threads_started":1}
I20260809 06:52:59.904003 19705 raft_consensus.cc:504] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.904704 19705 leader_election.cc:288] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [CANDIDATE]: Term 1 election: Requested vote from peers 720d22b98b714aafa6272082084d56ca (127.10.205.66:40765), 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379)
I20260809 06:52:59.905421 19471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee8d48b4d1eb491cbe58add4c65568e5" candidate_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "720d22b98b714aafa6272082084d56ca"
I20260809 06:52:59.905550 19620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee8d48b4d1eb491cbe58add4c65568e5" candidate_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" is_pre_election: true
I20260809 06:52:59.905668 19471 raft_consensus.cc:3037] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:59.905862 19619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee8d48b4d1eb491cbe58add4c65568e5" candidate_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625"
I20260809 06:52:59.905864 19620 raft_consensus.cc:2454] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03572e22c494ba7b7c9015b8c5dc36b in term 0.
I20260809 06:52:59.908659 19471 raft_consensus.cc:2454] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03572e22c494ba7b7c9015b8c5dc36b in term 1.
I20260809 06:52:59.909128 19242 leader_election.cc:302] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 720d22b98b714aafa6272082084d56ca, d03572e22c494ba7b7c9015b8c5dc36b; no voters: 3c9a7cfd3f06462dbbae4b9dd9ba8625
I20260809 06:52:59.909451 19705 raft_consensus.cc:2781] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:52:59.909997 19705 raft_consensus.cc:686] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 1 LEADER]: Becoming Leader. State: Replica: d03572e22c494ba7b7c9015b8c5dc36b, State: Running, Role: LEADER
I20260809 06:52:59.910430 19705 consensus_queue.cc:237] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:52:59.922973 19147 catalog_manager.cc:5495] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b reported cstate change: term changed from 0 to 1, leader changed from <none> to d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65). New cstate: current_term: 1 leader_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260809 06:52:59.942313 19783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:52:59.934858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35458 (local address 127.10.205.65:32983)
0809 06:52:59.936758 (+ 1900us) server_negotiation.cc:206] Beginning negotiation
0809 06:52:59.936762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:52:59.936780 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:52:59.936862 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:52:59.936867 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:52:59.936939 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:52:59.937117 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:52:59.937598 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.938430 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.939832 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:52:59.940320 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:52:59.940461 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:52:59.940955 (+ 494us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:52:59.941579 (+ 624us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:52:59.941738 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 06:52:59.941830 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 06:52:59.941913 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1786,"thread_start_us":1654,"threads_started":1}
I20260809 06:52:59.946137 19620 raft_consensus.cc:3037] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:52:59.946671 19471 raft_consensus.cc:1261] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Refusing update from remote peer d03572e22c494ba7b7c9015b8c5dc36b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:59.947393 19780 consensus_queue.cc:1035] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [LEADER]: Connected to new peer: Peer: permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:59.950029 19620 raft_consensus.cc:1261] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Refusing update from remote peer d03572e22c494ba7b7c9015b8c5dc36b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:52:59.950795 19780 consensus_queue.cc:1035] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:52:59.983467 19147 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:59.983737 19147 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:52:59.987960 19147 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795: Sending DeleteTablet for 3 replicas of tablet ee8d48b4d1eb491cbe58add4c65568e5
I20260809 06:52:59.988878 19295 tablet_service.cc:1514] Processing DeleteTablet for tablet ee8d48b4d1eb491cbe58add4c65568e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:59 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:35456
I20260809 06:52:59.989275 19728 tablet_replica.cc:330] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b: stopping tablet replica
I20260809 06:52:59.989509 19728 raft_consensus.cc:2229] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:52:59.989976 19728 raft_consensus.cc:2258] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:59.990020 19447 tablet_service.cc:1514] Processing DeleteTablet for tablet ee8d48b4d1eb491cbe58add4c65568e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:59 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:33368
I20260809 06:52:59.990358 19726 tablet_replica.cc:330] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca: stopping tablet replica
I20260809 06:52:59.990538 19726 raft_consensus.cc:2229] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:59.990800 19726 raft_consensus.cc:2258] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:59.991376 19599 tablet_service.cc:1514] Processing DeleteTablet for tablet ee8d48b4d1eb491cbe58add4c65568e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:52:59 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:58208
I20260809 06:52:59.991953 19726 ts_tablet_manager.cc:1905] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:52:59.992450 19727 tablet_replica.cc:330] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: stopping tablet replica
I20260809 06:52:59.992630 19727 raft_consensus.cc:2229] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:52:59.992810 19727 pending_rounds.cc:62] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Trying to abort 2 pending ops.
I20260809 06:52:59.992930 19727 pending_rounds.cc:68] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316514324252688384 op_type: WRITE_OP write_request { tablet_id: "ee8d48b4d1eb491cbe58add4c65568e5" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\367\311\340\323\006\"8\n\ntest-admin\022*\n 066f70883c694030a90d3461064a8427\020\001\030\001 \001(\001" signature: "<redacted>""\207\3608J\215\230n\027\333Jn?\302\212d\235\010%\221k\300\262\230=\257\023]\276V\007:\330\300wi\272\236\354\\\303\352\274\302\324\017~\261k\304:\030m&u5\212+\243\225m\3252S\220" signing_key_seq_num: 0 } } request_id { client_id: "eadb28dbaa0e4676ba0b1603baafb0d1" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260809 06:52:59.993110 19145 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35492:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 06:52:59.993706 19727 pending_rounds.cc:68] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316514324117450752 op_type: NO_OP noop_request { }
W20260809 06:52:59.993808 19145 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:52:59.993870 19727 raft_consensus.cc:2866] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260809 06:52:59.994063 19727 raft_consensus.cc:2258] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:52:59.995144 19728 ts_tablet_manager.cc:1905] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:53:00.002700 19726 ts_tablet_manager.cc:1918] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:53:00.002862 19726 log.cc:1196] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/ee8d48b4d1eb491cbe58add4c65568e5
I20260809 06:53:00.003072 19447 tablet_service.cc:1467] Processing CreateTablet for tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc (DEFAULT_TABLE table=test-table [id=bc9a6f9112194ddc8bf937149d664c13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:53:00.003316 19726 ts_tablet_manager.cc:1939] T ee8d48b4d1eb491cbe58add4c65568e5 P 720d22b98b714aafa6272082084d56ca: Deleting consensus metadata
I20260809 06:53:00.003521 19447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:53:00.004454 19133 catalog_manager.cc:4841] TS 720d22b98b714aafa6272082084d56ca (127.10.205.66:40765): tablet ee8d48b4d1eb491cbe58add4c65568e5 (table test-table [id=066f70883c694030a90d3461064a8427]) successfully deleted
I20260809 06:53:00.007483 19295 tablet_service.cc:1467] Processing CreateTablet for tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc (DEFAULT_TABLE table=test-table [id=bc9a6f9112194ddc8bf937149d664c13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:53:00.007930 19295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:53:00.011092 19728 ts_tablet_manager.cc:1918] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:53:00.011229 19728 log.cc:1196] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/ee8d48b4d1eb491cbe58add4c65568e5
I20260809 06:53:00.011677 19728 ts_tablet_manager.cc:1939] T ee8d48b4d1eb491cbe58add4c65568e5 P d03572e22c494ba7b7c9015b8c5dc36b: Deleting consensus metadata
I20260809 06:53:00.013321 19599 tablet_service.cc:1467] Processing CreateTablet for tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc (DEFAULT_TABLE table=test-table [id=bc9a6f9112194ddc8bf937149d664c13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:53:00.013875 19599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:53:00.019675 19700 tablet_bootstrap.cc:492] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca: Bootstrap starting.
I20260809 06:53:00.021016 19132 catalog_manager.cc:4841] TS d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983): tablet ee8d48b4d1eb491cbe58add4c65568e5 (table test-table [id=066f70883c694030a90d3461064a8427]) successfully deleted
I20260809 06:53:00.021525 19700 tablet_bootstrap.cc:654] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca: Neither blocks nor log segments found. Creating new log.
I20260809 06:53:00.026482 19699 tablet_bootstrap.cc:492] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Bootstrap starting.
I20260809 06:53:00.028180 19699 tablet_bootstrap.cc:654] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Neither blocks nor log segments found. Creating new log.
I20260809 06:53:00.034869 19698 tablet_bootstrap.cc:492] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b: Bootstrap starting.
I20260809 06:53:00.039362 19698 tablet_bootstrap.cc:654] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b: Neither blocks nor log segments found. Creating new log.
I20260809 06:53:00.043216 19727 ts_tablet_manager.cc:1905] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:53:00.054134 19699 tablet_bootstrap.cc:492] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625: No bootstrap required, opened a new log
I20260809 06:53:00.054373 19699 ts_tablet_manager.cc:1397] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.000s
I20260809 06:53:00.055425 19727 ts_tablet_manager.cc:1918] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:53:00.055361 19699 raft_consensus.cc:348] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:53:00.056790 19699 raft_consensus.cc:374] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:53:00.056895 19699 raft_consensus.cc:729] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c9a7cfd3f06462dbbae4b9dd9ba8625, State: Initialized, Role: FOLLOWER
I20260809 06:53:00.056946 19727 log.cc:1196] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/ee8d48b4d1eb491cbe58add4c65568e5
I20260809 06:53:00.057174 19699 consensus_queue.cc:260] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:53:00.057687 19727 ts_tablet_manager.cc:1939] T ee8d48b4d1eb491cbe58add4c65568e5 P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Deleting consensus metadata
I20260809 06:53:00.061762 19698 tablet_bootstrap.cc:492] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b: No bootstrap required, opened a new log
I20260809 06:53:00.062088 19698 ts_tablet_manager.cc:1397] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.006s
I20260809 06:53:00.063054 19698 raft_consensus.cc:348] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:53:00.063421 19698 raft_consensus.cc:374] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:53:00.063563 19698 raft_consensus.cc:729] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03572e22c494ba7b7c9015b8c5dc36b, State: Initialized, Role: FOLLOWER
I20260809 06:53:00.063922 19698 consensus_queue.cc:260] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:53:00.064656 19698 ts_tablet_manager.cc:1428] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 06:53:00.057741 19699 ts_tablet_manager.cc:1428] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 06:53:00.069583 19133 catalog_manager.cc:4841] TS 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379): tablet ee8d48b4d1eb491cbe58add4c65568e5 (table test-table [id=066f70883c694030a90d3461064a8427]) successfully deleted
I20260809 06:53:00.071141 19700 tablet_bootstrap.cc:492] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca: No bootstrap required, opened a new log
I20260809 06:53:00.071346 19700 ts_tablet_manager.cc:1397] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca: Time spent bootstrapping tablet: real 0.052s user 0.011s sys 0.008s
I20260809 06:53:00.072237 19700 raft_consensus.cc:348] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:53:00.073601 19700 raft_consensus.cc:374] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:53:00.073694 19700 raft_consensus.cc:729] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 720d22b98b714aafa6272082084d56ca, State: Initialized, Role: FOLLOWER
I20260809 06:53:00.073983 19700 consensus_queue.cc:260] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:53:00.074623 19700 ts_tablet_manager.cc:1428] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 06:53:00.152513 19721 raft_consensus.cc:482] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:53:00.152766 19721 raft_consensus.cc:504] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:53:00.153558 19721 leader_election.cc:288] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983), 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379)
I20260809 06:53:00.154544 19317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dc0af9d1ad542c6b1e2a4a7e2e1fedc" candidate_uuid: "720d22b98b714aafa6272082084d56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" is_pre_election: true
I20260809 06:53:00.154855 19317 raft_consensus.cc:2454] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 720d22b98b714aafa6272082084d56ca in term 0.
I20260809 06:53:00.155422 19393 leader_election.cc:302] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 720d22b98b714aafa6272082084d56ca, d03572e22c494ba7b7c9015b8c5dc36b; no voters:
I20260809 06:53:00.156184 19620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dc0af9d1ad542c6b1e2a4a7e2e1fedc" candidate_uuid: "720d22b98b714aafa6272082084d56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" is_pre_election: true
I20260809 06:53:00.156479 19620 raft_consensus.cc:2454] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 720d22b98b714aafa6272082084d56ca in term 0.
I20260809 06:53:00.157666 19721 raft_consensus.cc:2781] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:53:00.157829 19721 raft_consensus.cc:482] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:53:00.157940 19721 raft_consensus.cc:3037] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:53:00.161356 19721 raft_consensus.cc:504] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:53:00.162660 19317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dc0af9d1ad542c6b1e2a4a7e2e1fedc" candidate_uuid: "720d22b98b714aafa6272082084d56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d03572e22c494ba7b7c9015b8c5dc36b"
I20260809 06:53:00.162918 19317 raft_consensus.cc:3037] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:53:00.167913 19317 raft_consensus.cc:2454] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 720d22b98b714aafa6272082084d56ca in term 1.
I20260809 06:53:00.168872 19393 leader_election.cc:302] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 720d22b98b714aafa6272082084d56ca, d03572e22c494ba7b7c9015b8c5dc36b; no voters:
I20260809 06:53:00.169241 19710 raft_consensus.cc:2781] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:53:00.169440 19710 raft_consensus.cc:686] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 1 LEADER]: Becoming Leader. State: Replica: 720d22b98b714aafa6272082084d56ca, State: Running, Role: LEADER
I20260809 06:53:00.169751 19710 consensus_queue.cc:237] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } }
I20260809 06:53:00.175254 19620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dc0af9d1ad542c6b1e2a4a7e2e1fedc" candidate_uuid: "720d22b98b714aafa6272082084d56ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625"
I20260809 06:53:00.175586 19620 raft_consensus.cc:3037] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:53:00.179638 19620 raft_consensus.cc:2454] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 720d22b98b714aafa6272082084d56ca in term 1.
I20260809 06:53:00.180325 19721 leader_election.cc:288] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [CANDIDATE]: Term 1 election: Requested vote from peers d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983), 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379)
I20260809 06:53:00.197319 19147 catalog_manager.cc:5495] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 720d22b98b714aafa6272082084d56ca (127.10.205.66). New cstate: current_term: 1 leader_uuid: "720d22b98b714aafa6272082084d56ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "720d22b98b714aafa6272082084d56ca" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 } health_report { overall_health: UNKNOWN } } }
I20260809 06:53:00.266047 19697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:00.258010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33386 (local address 127.10.205.66:40765)
0809 06:53:00.258194 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:00.258202 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:00.258222 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:53:00.258301 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:00.258306 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:00.258407 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:00.258499 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:53:00.259133 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:00.260342 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:00.262878 (+ 2536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:00.263810 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:00.263969 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:00.264834 (+ 865us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:53:00.265038 (+ 204us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:53:00.265132 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:00.265625 (+ 493us) server_negotiation.cc:299] Negotiation successful
0809 06:53:00.265708 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:53:00.318611 19697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:00.297957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:54261 (local address 127.10.205.66:40765)
0809 06:53:00.298195 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:00.298202 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:00.312083 (+ 13881us) server_negotiation.cc:407] Connection header received
0809 06:53:00.312321 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:00.312325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:00.312404 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:00.312489 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:53:00.313098 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:00.314220 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:00.316427 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:00.317136 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:00.317252 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:00.317855 (+ 603us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:53:00.317985 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:53:00.318048 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:00.318228 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 06:53:00.318315 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 06:53:00.319387 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:00.297496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:40765 (local address 127.10.205.66:54261)
0809 06:53:00.311946 (+ 14450us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:00.311974 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:00.312171 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:00.312557 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:00.312566 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:00.312579 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:53:00.312905 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:00.312917 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:00.314434 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:00.314439 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:00.316222 (+ 1783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:00.316243 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:00.317458 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:00.317467 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:00.317629 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:00.317693 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:53:00.318109 (+ 416us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:53:00.318118 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 06:53:00.318856 (+ 738us) client_negotiation.cc:240] Negotiation successful
0809 06:53:00.318993 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14251,"mutex_wait_us":1,"thread_start_us":14797,"threads_started":1}
I20260809 06:53:00.330513 19620 raft_consensus.cc:1261] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Refusing update from remote peer 720d22b98b714aafa6272082084d56ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:53:00.331279 19710 consensus_queue.cc:1035] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c9a7cfd3f06462dbbae4b9dd9ba8625" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:53:00.333742 19317 raft_consensus.cc:1261] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Refusing update from remote peer 720d22b98b714aafa6272082084d56ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:53:00.334400 19721 consensus_queue.cc:1035] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03572e22c494ba7b7c9015b8c5dc36b" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 32983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:53:00.411317 19147 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:53:00.411655 19147 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:53:00.415153 19147 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a663e22998394f79b43f79517d586795: Sending DeleteTablet for 3 replicas of tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc
I20260809 06:53:00.416334 19295 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:53:00 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:35456
I20260809 06:53:00.416342 19599 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:53:00 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:58208
I20260809 06:53:00.416666 19727 tablet_replica.cc:330] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625: stopping tablet replica
I20260809 06:53:00.416889 19727 raft_consensus.cc:2229] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:53:00.417104 19727 raft_consensus.cc:2258] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:53:00.417430 19728 tablet_replica.cc:330] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b: stopping tablet replica
I20260809 06:53:00.417655 19728 raft_consensus.cc:2229] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:53:00.417874 19728 raft_consensus.cc:2258] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:53:00.418212 19447 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:53:00 UTC) from {username='oryx', principal='oryx/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:33368
I20260809 06:53:00.418476 19727 ts_tablet_manager.cc:1905] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:53:00.418525 19726 tablet_replica.cc:330] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca: stopping tablet replica
I20260809 06:53:00.418730 19726 raft_consensus.cc:2229] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:53:00.418999 19728 ts_tablet_manager.cc:1905] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:53:00.419107 19726 raft_consensus.cc:2258] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:53:00.420444 19726 ts_tablet_manager.cc:1905] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:53:00.425041 19727 ts_tablet_manager.cc:1918] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:53:00.425196 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 19223
I20260809 06:53:00.425220 19727 log.cc:1196] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/7dc0af9d1ad542c6b1e2a4a7e2e1fedc
I20260809 06:53:00.425652 19727 ts_tablet_manager.cc:1939] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 3c9a7cfd3f06462dbbae4b9dd9ba8625: Deleting consensus metadata
I20260809 06:53:00.426025 19728 ts_tablet_manager.cc:1918] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:53:00.426215 19728 log.cc:1196] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/7dc0af9d1ad542c6b1e2a4a7e2e1fedc
I20260809 06:53:00.426712 19728 ts_tablet_manager.cc:1939] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P d03572e22c494ba7b7c9015b8c5dc36b: Deleting consensus metadata
I20260809 06:53:00.426936 19133 catalog_manager.cc:4841] TS 3c9a7cfd3f06462dbbae4b9dd9ba8625 (127.10.205.67:37379): tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc (table test-table [id=bc9a6f9112194ddc8bf937149d664c13]) successfully deleted
I20260809 06:53:00.428056 19132 catalog_manager.cc:4841] TS d03572e22c494ba7b7c9015b8c5dc36b (127.10.205.65:32983): tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc (table test-table [id=bc9a6f9112194ddc8bf937149d664c13]) successfully deleted
I20260809 06:53:00.433252 19726 ts_tablet_manager.cc:1918] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:53:00.433429 19726 log.cc:1196] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/7dc0af9d1ad542c6b1e2a4a7e2e1fedc
I20260809 06:53:00.433869 19726 ts_tablet_manager.cc:1939] T 7dc0af9d1ad542c6b1e2a4a7e2e1fedc P 720d22b98b714aafa6272082084d56ca: Deleting consensus metadata
I20260809 06:53:00.435137 19133 catalog_manager.cc:4841] TS 720d22b98b714aafa6272082084d56ca (127.10.205.66:40765): tablet 7dc0af9d1ad542c6b1e2a4a7e2e1fedc (table test-table [id=bc9a6f9112194ddc8bf937149d664c13]) successfully deleted
Aug 09 06:53:00 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.205.65@KRBTEST.COM
I20260809 06:53:00.452358 19783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:00.427760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35468 (local address 127.10.205.65:32983)
0809 06:53:00.427965 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:00.427974 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:00.435621 (+ 7647us) server_negotiation.cc:407] Connection header received
0809 06:53:00.435815 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:00.435819 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:00.435886 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:00.435986 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:00.437672 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:00.438436 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:00.440354 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:00.440814 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:00.440908 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:00.445796 (+ 4888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:00.445809 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:00.445825 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:00.445860 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:00.449168 (+ 3308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:00.449952 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:00.449960 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:00.449962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:00.450135 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:00.450556 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:00.450560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:00.450562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:00.450945 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:00.451312 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:00.451615 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 06:53:00.451874 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 06:53:00.453110 19364 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:00.608462 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 19223
I20260809 06:53:00.633752 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 19374
Aug 09 06:53:00 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.205.66@KRBTEST.COM
I20260809 06:53:00.649469 19697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:00.634617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43992 (local address 127.10.205.66:40765)
0809 06:53:00.634824 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:00.634829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:00.634848 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:53:00.635007 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:00.635011 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:00.635073 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:00.635159 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:00.636484 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:00.637166 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:00.638397 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:00.638831 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:00.638938 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:00.643073 (+ 4135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:00.643090 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:00.643106 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:00.643154 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:00.646354 (+ 3200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:00.647000 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:00.647007 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:00.647009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:00.647220 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:00.647533 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:00.647536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:00.647537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:00.647876 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:00.648172 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:00.648698 (+ 526us) server_negotiation.cc:299] Negotiation successful
0809 06:53:00.648989 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 06:53:00.650197 19518 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:00.803689 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 19374
I20260809 06:53:00.834131 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 19527
Aug 09 06:53:00 dist-test-slave-0b58 krb5kdc[19099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.205.67@KRBTEST.COM
I20260809 06:53:00.850004 19804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:00.834946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44748 (local address 127.10.205.67:37379)
0809 06:53:00.835469 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:00.835474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:00.835489 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:53:00.835547 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:00.835551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:00.835616 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:00.835734 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:00.837199 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:00.837940 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:00.839192 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:00.839590 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:00.839725 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:00.844241 (+ 4516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:00.844335 (+ 94us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:00.844353 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:00.844391 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:00.847045 (+ 2654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:00.847725 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:00.847733 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:00.847735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:00.847918 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:00.848354 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:00.848361 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:00.848365 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:00.848745 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:00.849066 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:00.849403 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 06:53:00.849659 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":254,"threads_started":1}
I20260809 06:53:00.850785 19666 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:00.978482 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 19527
I20260809 06:53:01.006618 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 19113
I20260809 06:53:01.007980 19191 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:01.127117 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 19113
2026-08-09T06:53:01Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6037 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:53:01 dist-test-slave-0b58 krb5kdc[19810](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:53:01 dist-test-slave-0b58 krb5kdc[19810](info): set up 2 sockets
Aug 09 06:53:01 dist-test-slave-0b58 krb5kdc[19810](info): commencing operation
krb5kdc: starting...
W20260809 06:53:02.280340 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.003s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:53:02 dist-test-slave-0b58 krb5kdc[19810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:53:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:53:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:53:02.555903 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:46849
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:46849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:53:02.894347 19824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:02.894644 19824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:02.894744 19824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:02.902132 19824 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:53:02.902261 19824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:02.902354 19824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:02.902468 19824 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:53:02.902561 19824 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:53:02.912917 19824 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:46849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:46849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:02.914311 19824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:02.915679 19824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:02.928032 19829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:02.928040 19830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:02.928277 19832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:02.929106 19824 server_base.cc:1034] running on GCE node
I20260809 06:53:02.929934 19824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:02.931385 19824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:02.932626 19824 hybrid_clock.cc:648] HybridClock initialized: now 1786258382932588 us; error 57 us; skew 500 ppm
I20260809 06:53:02.933046 19824 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T06:53:03Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1878 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:53:03 dist-test-slave-0b58 krb5kdc[19838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:53:03 dist-test-slave-0b58 krb5kdc[19838](info): set up 2 sockets
Aug 09 06:53:03 dist-test-slave-0b58 krb5kdc[19838](info): commencing operation
krb5kdc: starting...
W20260809 06:53:04.148625 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.001s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:53:04 dist-test-slave-0b58 krb5kdc[19838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:53:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:53:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:53:04.432241 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:39063
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:39063
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:53:04.777272 19853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:04.777670 19853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:04.777853 19853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:04.785274 19853 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:53:04.785459 19853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:04.785573 19853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:04.785691 19853 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:53:04.785780 19853 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:53:04.796016 19853 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:39063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:39063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:04.797521 19853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:04.798967 19853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:04.811609 19863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:04.811679 19860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:04.811715 19859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:04.812647 19853 server_base.cc:1034] running on GCE node
I20260809 06:53:04.813588 19853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:04.815124 19853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:04.816371 19853 hybrid_clock.cc:648] HybridClock initialized: now 1786258384816316 us; error 47 us; skew 500 ppm
I20260809 06:53:04.816766 19853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:53:04 dist-test-slave-0b58 krb5kdc[19838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258384, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:53:04.820106 19853 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:53:04.821712 19853 webserver.cc:460] Webserver started at http://127.10.205.126:43057/ using document root <none> and password file <none>
I20260809 06:53:04.822471 19853 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:04.822631 19853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:04.822978 19853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:04.826216 19853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "835bf24d82c2448a9d4b6fcb271f1d42"
format_stamp: "Formatted at 2026-08-09 06:53:04 on dist-test-slave-0b58"
server_key: "0074750722f111601e5bfc56b9f41be5"
server_key_iv: "68abb21374c5e3260c0d122612076ea0"
server_key_version: "encryptionkey@0"
I20260809 06:53:04.827026 19853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "835bf24d82c2448a9d4b6fcb271f1d42"
format_stamp: "Formatted at 2026-08-09 06:53:04 on dist-test-slave-0b58"
server_key: "0074750722f111601e5bfc56b9f41be5"
server_key_iv: "68abb21374c5e3260c0d122612076ea0"
server_key_version: "encryptionkey@0"
I20260809 06:53:04.832782 19853 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 06:53:04.836603 19870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:04.837975 19853 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:53:04.838178 19853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "835bf24d82c2448a9d4b6fcb271f1d42"
format_stamp: "Formatted at 2026-08-09 06:53:04 on dist-test-slave-0b58"
server_key: "0074750722f111601e5bfc56b9f41be5"
server_key_iv: "68abb21374c5e3260c0d122612076ea0"
server_key_version: "encryptionkey@0"
I20260809 06:53:04.838409 19853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:04.863029 19853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:04.867607 19853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:04.867960 19853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:04.888551 19853 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:39063
I20260809 06:53:04.888579 19925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:39063 every 8 connection(s)
I20260809 06:53:04.890030 19853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:53:04.891642 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 19853
I20260809 06:53:04.891916 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:53:04.892652 11061 external_mini_cluster.cc:1428] Setting key 2a5e5f2d08db3b4a3471d67c93de31cf
I20260809 06:53:04.894556 19926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:53:04.909968 19926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42: Bootstrap starting.
Aug 09 06:53:04 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:53:04.913887 19926 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42: Neither blocks nor log segments found. Creating new log.
I20260809 06:53:04.914991 19926 log.cc:824] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42: Log is configured to *not* fsync() on all Append() calls
I20260809 06:53:04.918598 19926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42: No bootstrap required, opened a new log
I20260809 06:53:04.919683 19929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:04.895099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59500 (local address 127.10.205.126:39063)
0809 06:53:04.897340 (+ 2241us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:04.897355 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:04.897406 (+ 51us) server_negotiation.cc:407] Connection header received
0809 06:53:04.899983 (+ 2577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:04.900012 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:04.900549 (+ 537us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:04.900994 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:04.902364 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:04.904411 (+ 2047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:04.905718 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:04.906882 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:04.907072 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:04.911725 (+ 4653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:04.911736 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:04.911754 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:04.911806 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:04.915154 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:04.916047 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:04.916056 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:04.916071 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:04.916386 (+ 315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:04.916848 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:04.916852 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:04.916854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:04.917421 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:04.917662 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:04.918179 (+ 517us) server_negotiation.cc:299] Negotiation successful
0809 06:53:04.918588 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2011,"thread_start_us":1750,"threads_started":1}
I20260809 06:53:04.926944 19926 raft_consensus.cc:348] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39063 } }
I20260809 06:53:04.927350 19926 raft_consensus.cc:374] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:53:04.927476 19926 raft_consensus.cc:729] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 835bf24d82c2448a9d4b6fcb271f1d42, State: Initialized, Role: FOLLOWER
I20260809 06:53:04.928129 19926 consensus_queue.cc:260] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39063 } }
I20260809 06:53:04.928462 19926 raft_consensus.cc:388] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:53:04.928639 19926 raft_consensus.cc:482] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:53:04.928834 19926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:53:04.931042 19926 raft_consensus.cc:504] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39063 } }
I20260809 06:53:04.931571 19926 leader_election.cc:302] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 835bf24d82c2448a9d4b6fcb271f1d42; no voters:
I20260809 06:53:04.932209 19926 leader_election.cc:288] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:53:04.932422 19931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:53:04.933231 19931 raft_consensus.cc:686] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 1 LEADER]: Becoming Leader. State: Replica: 835bf24d82c2448a9d4b6fcb271f1d42, State: Running, Role: LEADER
I20260809 06:53:04.933751 19931 consensus_queue.cc:237] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39063 } }
I20260809 06:53:04.934429 19926 sys_catalog.cc:564] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:53:04.938019 19933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 835bf24d82c2448a9d4b6fcb271f1d42. Latest consensus state: current_term: 1 leader_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39063 } } }
I20260809 06:53:04.938407 19933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [sys.catalog]: This master's current role is: LEADER
I20260809 06:53:04.938648 19932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39063 } } }
I20260809 06:53:04.939116 19932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [sys.catalog]: This master's current role is: LEADER
I20260809 06:53:04.942416 19938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:53:04.947943 19938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:53:04.957904 19938 catalog_manager.cc:1347] Generated new cluster ID: 8e61c665285b4d129d179c9a801acfce
I20260809 06:53:04.958036 19938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:53:04.980123 19938 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:53:04.981710 19938 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:53:04.993369 19938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42: Generated new TSK 0
I20260809 06:53:04.994594 19938 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:53:05.076563 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39063
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:53:05.424775 19953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:05.425148 19953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:05.425329 19953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:05.433050 19953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:05.433256 19953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:05.433455 19953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:53:05.444351 19953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:05.445886 19953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:05.447265 19953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:05.461263 19960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:05.461401 19962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:05.461393 19959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:05.462337 19953 server_base.cc:1034] running on GCE node
I20260809 06:53:05.463027 19953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:05.464107 19953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:05.465378 19953 hybrid_clock.cc:648] HybridClock initialized: now 1786258385465273 us; error 81 us; skew 500 ppm
I20260809 06:53:05.465726 19953 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:53:05 dist-test-slave-0b58 krb5kdc[19838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258385, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:53:05.469013 19953 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:53:05.470557 19953 webserver.cc:460] Webserver started at http://127.10.205.65:39551/ using document root <none> and password file <none>
I20260809 06:53:05.471303 19953 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:05.471463 19953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:05.471799 19953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:05.474922 19953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "fe91c90efebf41e1802a130e99363d81"
format_stamp: "Formatted at 2026-08-09 06:53:05 on dist-test-slave-0b58"
server_key: "e4b02c20579b770cd07e4c50a049fd89"
server_key_iv: "6c118d2c29cd621872f8e83f21c81753"
server_key_version: "encryptionkey@0"
I20260809 06:53:05.475863 19953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "fe91c90efebf41e1802a130e99363d81"
format_stamp: "Formatted at 2026-08-09 06:53:05 on dist-test-slave-0b58"
server_key: "e4b02c20579b770cd07e4c50a049fd89"
server_key_iv: "6c118d2c29cd621872f8e83f21c81753"
server_key_version: "encryptionkey@0"
I20260809 06:53:05.481566 19953 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 06:53:05.485267 19969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:05.486716 19953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:53:05.486922 19953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "fe91c90efebf41e1802a130e99363d81"
format_stamp: "Formatted at 2026-08-09 06:53:05 on dist-test-slave-0b58"
server_key: "e4b02c20579b770cd07e4c50a049fd89"
server_key_iv: "6c118d2c29cd621872f8e83f21c81753"
server_key_version: "encryptionkey@0"
I20260809 06:53:05.487182 19953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:05.519258 19953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:05.523641 19953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:05.523988 19953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:05.525080 19953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:05.526556 19953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:05.526660 19953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:05.526844 19953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:05.526926 19953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:05.562319 19953 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:34863
I20260809 06:53:05.562418 20091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:34863 every 8 connection(s)
I20260809 06:53:05.563710 19953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:53:05.567950 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 19953
I20260809 06:53:05.568192 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:53:05.568964 11061 external_mini_cluster.cc:1428] Setting key ce9a060a7db15d26fa54667a8a63d7a3
Aug 09 06:53:05 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258385, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:53:05.584822 20094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:05.566604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:53391 (local address 127.10.205.126:39063)
0809 06:53:05.567095 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:05.567101 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:05.568226 (+ 1125us) server_negotiation.cc:407] Connection header received
0809 06:53:05.570383 (+ 2157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:05.570389 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:05.570485 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:05.570611 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:05.572195 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:05.572995 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:05.574585 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:05.574993 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:05.575150 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:05.578747 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:05.578752 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:05.578755 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:05.578788 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:05.581563 (+ 2775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:05.582343 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:05.582351 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:05.582357 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:05.582492 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:05.582950 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:05.582956 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:05.582959 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:05.583251 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:05.583428 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:05.584173 (+ 745us) server_negotiation.cc:299] Negotiation successful
0809 06:53:05.584442 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":234,"threads_started":1}
I20260809 06:53:05.585886 20095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:05.567235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:53391)
0809 06:53:05.568045 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:05.568084 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:05.570099 (+ 2015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:05.570872 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:05.570880 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:05.571412 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:05.572003 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:05.572023 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:05.573169 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:05.573174 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:05.574424 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:05.574437 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:05.575239 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:05.575249 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:05.575487 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:05.576311 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:05.576342 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:05.578489 (+ 2147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:53:05.581727 (+ 3238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:53:05.581737 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:53:05.581755 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:53:05.582211 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:53:05.582626 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:53:05.582632 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:53:05.582636 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:53:05.582831 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:53:05.583401 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:53:05.583409 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:53:05.583772 (+ 363us) client_negotiation.cc:769] Sending connection context
0809 06:53:05.584076 (+ 304us) client_negotiation.cc:240] Negotiation successful
0809 06:53:05.584671 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":348,"threads_started":1}
I20260809 06:53:05.587608 20092 heartbeater.cc:347] Connected to a master server at 127.10.205.126:39063
I20260809 06:53:05.587955 20092 heartbeater.cc:464] Registering TS with master...
I20260809 06:53:05.588932 20092 heartbeater.cc:511] Master 127.10.205.126:39063 requested a full tablet report, sending...
I20260809 06:53:05.591392 19889 ts_manager.cc:194] Registered new tserver with Master: fe91c90efebf41e1802a130e99363d81 (127.10.205.65:34863)
I20260809 06:53:05.593005 19889 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:53391
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:53:05.634117 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39063
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:53:05.981175 20098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:05.981482 20098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:05.981580 20098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:05.988794 20098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:05.988898 20098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:05.989012 20098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:53:05.999125 20098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:06.000476 20098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:06.001888 20098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:06.015960 20105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:06.016050 20107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:06.015995 20104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:06.016945 20098 server_base.cc:1034] running on GCE node
I20260809 06:53:06.017606 20098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:06.018571 20098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:06.019866 20098 hybrid_clock.cc:648] HybridClock initialized: now 1786258386019812 us; error 84 us; skew 500 ppm
I20260809 06:53:06.020238 20098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:53:06 dist-test-slave-0b58 krb5kdc[19838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258386, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:53:06.023566 20098 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:53:06.025205 20098 webserver.cc:460] Webserver started at http://127.10.205.66:35147/ using document root <none> and password file <none>
I20260809 06:53:06.025969 20098 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:06.026144 20098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:06.026496 20098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:06.029606 20098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "e443c1ee77494a68b73273ea6c25ba50"
format_stamp: "Formatted at 2026-08-09 06:53:06 on dist-test-slave-0b58"
server_key: "ecbe4c630e8e0e6aa91450d64bd2f0d0"
server_key_iv: "06d3a1984a2229c96b3468d538e7d3cd"
server_key_version: "encryptionkey@0"
I20260809 06:53:06.030468 20098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "e443c1ee77494a68b73273ea6c25ba50"
format_stamp: "Formatted at 2026-08-09 06:53:06 on dist-test-slave-0b58"
server_key: "ecbe4c630e8e0e6aa91450d64bd2f0d0"
server_key_iv: "06d3a1984a2229c96b3468d538e7d3cd"
server_key_version: "encryptionkey@0"
I20260809 06:53:06.035980 20098 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:53:06.039597 20114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:06.041080 20098 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:53:06.041337 20098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "e443c1ee77494a68b73273ea6c25ba50"
format_stamp: "Formatted at 2026-08-09 06:53:06 on dist-test-slave-0b58"
server_key: "ecbe4c630e8e0e6aa91450d64bd2f0d0"
server_key_iv: "06d3a1984a2229c96b3468d538e7d3cd"
server_key_version: "encryptionkey@0"
I20260809 06:53:06.041568 20098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:06.061633 20098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:06.066496 20098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:06.066831 20098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:06.067886 20098 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:06.069463 20098 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:06.069583 20098 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:06.069753 20098 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:06.069836 20098 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:06.107415 20098 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:38543
I20260809 06:53:06.107476 20236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:38543 every 8 connection(s)
I20260809 06:53:06.108937 20098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:53:06.113812 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 20098
I20260809 06:53:06.114048 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:53:06.114624 11061 external_mini_cluster.cc:1428] Setting key c694664924a42440833e7afc61f8dafa
Aug 09 06:53:06 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258386, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:53:06.135844 20240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:06.111977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:41933 (local address 127.10.205.126:39063)
0809 06:53:06.112515 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:06.112520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:06.113760 (+ 1240us) server_negotiation.cc:407] Connection header received
0809 06:53:06.116375 (+ 2615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:06.116382 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:06.116467 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:06.116596 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:06.118958 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:06.120083 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:06.122900 (+ 2817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:06.123473 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:06.123587 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:06.128790 (+ 5203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:06.128797 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:06.128800 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:06.128842 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:06.131821 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:06.132892 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:06.132898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:06.132900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:06.133044 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:06.133601 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:06.133605 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:06.133607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:06.133902 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:06.134078 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:06.135072 (+ 994us) server_negotiation.cc:299] Negotiation successful
0809 06:53:06.135377 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":311,"threads_started":1}
I20260809 06:53:06.137099 20241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:06.112621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:41933)
0809 06:53:06.113500 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:06.113565 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:06.115986 (+ 2421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:06.116845 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:06.116855 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:06.117701 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:06.118708 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:06.118740 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:06.120327 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:06.120336 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:06.122688 (+ 2352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:06.122711 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:06.123793 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:06.123804 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:06.124177 (+ 373us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:06.125146 (+ 969us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:06.125185 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:06.128444 (+ 3259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:53:06.132028 (+ 3584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:53:06.132039 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:53:06.132060 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:53:06.132715 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:53:06.133205 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:53:06.133210 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:53:06.133214 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:53:06.133437 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:53:06.134051 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:53:06.134061 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:53:06.134585 (+ 524us) client_negotiation.cc:769] Sending connection context
0809 06:53:06.134950 (+ 365us) client_negotiation.cc:240] Negotiation successful
0809 06:53:06.135595 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":310,"threads_started":1}
I20260809 06:53:06.139061 20237 heartbeater.cc:347] Connected to a master server at 127.10.205.126:39063
I20260809 06:53:06.139444 20237 heartbeater.cc:464] Registering TS with master...
I20260809 06:53:06.140363 20237 heartbeater.cc:511] Master 127.10.205.126:39063 requested a full tablet report, sending...
I20260809 06:53:06.142365 19889 ts_manager.cc:194] Registered new tserver with Master: e443c1ee77494a68b73273ea6c25ba50 (127.10.205.66:38543)
I20260809 06:53:06.143812 19889 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:41933
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:53:06.185073 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39063
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:53:06.538980 20244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:06.539327 20244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:06.539430 20244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:06.547150 20244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:06.547282 20244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:06.547408 20244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:53:06.557659 20244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:06.559125 20244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:06.560521 20244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:06.574486 20249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:06.574587 20252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:06.574561 20250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:06.575191 20244 server_base.cc:1034] running on GCE node
I20260809 06:53:06.575831 20244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:06.576851 20244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:06.578058 20244 hybrid_clock.cc:648] HybridClock initialized: now 1786258386578018 us; error 27 us; skew 500 ppm
I20260809 06:53:06.578397 20244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:53:06 dist-test-slave-0b58 krb5kdc[19838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258386, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:53:06.581579 20244 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:53:06.583060 20244 webserver.cc:460] Webserver started at http://127.10.205.67:37235/ using document root <none> and password file <none>
I20260809 06:53:06.583727 20244 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:06.583837 20244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:06.584091 20244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:06.587126 20244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "d4fea92aabf2424a80b67c8bafddf2a8"
format_stamp: "Formatted at 2026-08-09 06:53:06 on dist-test-slave-0b58"
server_key: "66f7dcb27871919432718e2dcb7dd7b9"
server_key_iv: "8f5ed6bdff0ee02bb19e7304910e56f2"
server_key_version: "encryptionkey@0"
I20260809 06:53:06.587890 20244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "d4fea92aabf2424a80b67c8bafddf2a8"
format_stamp: "Formatted at 2026-08-09 06:53:06 on dist-test-slave-0b58"
server_key: "66f7dcb27871919432718e2dcb7dd7b9"
server_key_iv: "8f5ed6bdff0ee02bb19e7304910e56f2"
server_key_version: "encryptionkey@0"
I20260809 06:53:06.593495 20244 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260809 06:53:06.596724 20092 heartbeater.cc:503] Master 127.10.205.126:39063 was elected leader, sending a full tablet report...
I20260809 06:53:06.596947 20259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:06.598426 20244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:53:06.598621 20244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "d4fea92aabf2424a80b67c8bafddf2a8"
format_stamp: "Formatted at 2026-08-09 06:53:06 on dist-test-slave-0b58"
server_key: "66f7dcb27871919432718e2dcb7dd7b9"
server_key_iv: "8f5ed6bdff0ee02bb19e7304910e56f2"
server_key_version: "encryptionkey@0"
I20260809 06:53:06.598857 20244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:06.622745 20244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:06.628019 20244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:06.628417 20244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:06.629565 20244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:06.630976 20244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:06.631091 20244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:06.631243 20244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:06.631325 20244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:06.666455 20244 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:32895
I20260809 06:53:06.666554 20380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:32895 every 8 connection(s)
I20260809 06:53:06.667845 20244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:53:06.670583 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 20244
I20260809 06:53:06.670815 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:53:06.671357 11061 external_mini_cluster.cc:1428] Setting key 4cddf698525bbbbe185ba407e157fd93
Aug 09 06:53:06 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258386, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:53:06.689113 20383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:06.670554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:42505 (local address 127.10.205.126:39063)
0809 06:53:06.671051 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:06.671058 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:06.672365 (+ 1307us) server_negotiation.cc:407] Connection header received
0809 06:53:06.674909 (+ 2544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:06.674915 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:06.675017 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:06.675116 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:06.676675 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:06.677458 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:06.678956 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:06.679347 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:06.679439 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:06.682853 (+ 3414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:06.682859 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:06.682862 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:06.682902 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:06.685494 (+ 2592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:06.686468 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:06.686472 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:06.686474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:06.686658 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:06.687164 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:06.687173 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:06.687176 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:06.687552 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:06.687731 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:06.688495 (+ 764us) server_negotiation.cc:299] Negotiation successful
0809 06:53:06.688717 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":264,"threads_started":1}
I20260809 06:53:06.690068 20384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:06.671242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:42505)
0809 06:53:06.672150 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:06.672206 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:06.674577 (+ 2371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:06.675349 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:06.675357 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:06.675878 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:06.676522 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:06.676542 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:06.677598 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:06.677601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:06.678816 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:06.678829 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:06.679538 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:06.679543 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:06.679731 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:06.680481 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:06.680504 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:06.682651 (+ 2147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:53:06.685650 (+ 2999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:53:06.685661 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:53:06.685678 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:53:06.686337 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:53:06.686801 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:53:06.686806 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:53:06.686809 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:53:06.687031 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:53:06.687700 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:53:06.687708 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:53:06.688067 (+ 359us) client_negotiation.cc:769] Sending connection context
0809 06:53:06.688383 (+ 316us) client_negotiation.cc:240] Negotiation successful
0809 06:53:06.688928 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":349,"threads_started":1}
I20260809 06:53:06.691502 20381 heartbeater.cc:347] Connected to a master server at 127.10.205.126:39063
I20260809 06:53:06.691891 20381 heartbeater.cc:464] Registering TS with master...
I20260809 06:53:06.692636 20381 heartbeater.cc:511] Master 127.10.205.126:39063 requested a full tablet report, sending...
I20260809 06:53:06.693981 19889 ts_manager.cc:194] Registered new tserver with Master: d4fea92aabf2424a80b67c8bafddf2a8 (127.10.205.67:32895)
I20260809 06:53:06.694751 19889 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:42505
I20260809 06:53:06.699831 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab.
Entry for principal oryx/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab.
WARNING: no policy specified for oryx/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab.
Entry for principal oryx/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab.
WARNING: no policy specified for oryx/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab.
Entry for principal oryx/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab.
I20260809 06:53:06.884104 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 19953
Aug 09 06:53:06 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:53:06.902462 20392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:06.885417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51108 (local address 127.10.205.65:34863)
0809 06:53:06.886099 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:06.886106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:06.886152 (+ 46us) server_negotiation.cc:407] Connection header received
0809 06:53:06.886225 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:06.886231 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:06.886469 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:06.886614 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:06.888027 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:06.889719 (+ 1692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:06.891047 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:06.891951 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:06.892080 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:06.896756 (+ 4676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:06.896775 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:06.896795 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:06.896837 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:06.899665 (+ 2828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:06.900408 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:06.900415 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:06.900417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:06.900548 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:06.900897 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:06.900901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:06.900903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:06.901247 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:06.901482 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:06.901725 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 06:53:06.902002 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":367,"threads_started":1}
I20260809 06:53:06.904191 20087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:06.990118 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 19953
I20260809 06:53:07.010488 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 20098
Aug 09 06:53:07 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:53:07.027135 20394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:07.011511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49998 (local address 127.10.205.66:38543)
0809 06:53:07.012106 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:07.012113 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:07.012139 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:53:07.012221 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:07.012227 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:07.012532 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:07.012666 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:07.014071 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:07.015080 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:07.016385 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:07.016926 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:07.017026 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:07.021709 (+ 4683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:07.021723 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:07.021739 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:07.021774 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:07.024625 (+ 2851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:07.025281 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:07.025288 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:07.025290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:07.025420 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:07.025738 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:07.025741 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:07.025743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:07.026079 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:07.026357 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:07.026613 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 06:53:07.026825 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":291,"threads_started":1}
I20260809 06:53:07.028744 20231 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:07.113361 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 20098
I20260809 06:53:07.133834 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 20244
Aug 09 06:53:07 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:53:07.151908 20396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:07.135138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56646 (local address 127.10.205.67:32895)
0809 06:53:07.135804 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:07.135812 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:07.135842 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:53:07.135902 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:07.135908 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:07.136121 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:07.136245 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:07.137612 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:07.138603 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:07.139937 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:07.140567 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:07.140667 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:07.145681 (+ 5014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:07.145714 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:07.145736 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:07.145789 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:07.149066 (+ 3277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:07.149959 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:07.149967 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:07.149970 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:07.150109 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:07.150494 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:07.150497 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:07.150499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:07.150876 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:07.151112 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:07.151369 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 06:53:07.151591 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":384,"threads_started":1}
I20260809 06:53:07.153370 20376 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:07.237669 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 20244
I20260809 06:53:07.256568 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 19853
I20260809 06:53:07.257849 19921 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:07.365061 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 19853
I20260809 06:53:07.389904 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:39063
--webserver_interface=127.10.205.126
--webserver_port=43057
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:39063
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:53:07.732497 20399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:07.732882 20399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:07.733068 20399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:07.740329 20399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:53:07.740500 20399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:07.740621 20399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:07.740739 20399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:53:07.740839 20399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:53:07.750926 20399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:39063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:39063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=43057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:07.752424 20399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:07.753810 20399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:07.766072 20405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:07.766037 20409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:07.766170 20406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:07.767258 20399 server_base.cc:1034] running on GCE node
I20260809 06:53:07.768138 20399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:07.769665 20399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:07.770874 20399 hybrid_clock.cc:648] HybridClock initialized: now 1786258387770811 us; error 55 us; skew 500 ppm
I20260809 06:53:07.771245 20399 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:53:07 dist-test-slave-0b58 krb5kdc[19838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258387, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:53:07.774595 20399 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:53:07.776188 20399 webserver.cc:460] Webserver started at http://127.10.205.126:43057/ using document root <none> and password file <none>
I20260809 06:53:07.776978 20399 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:07.777138 20399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:07.782797 20399 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 06:53:07.785742 20416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:07.787061 20399 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 06:53:07.787258 20399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "835bf24d82c2448a9d4b6fcb271f1d42"
format_stamp: "Formatted at 2026-08-09 06:53:04 on dist-test-slave-0b58"
server_key: "0074750722f111601e5bfc56b9f41be5"
server_key_iv: "68abb21374c5e3260c0d122612076ea0"
server_key_version: "encryptionkey@0"
I20260809 06:53:07.788266 20399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:07.816630 20399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:07.821024 20399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:07.821347 20399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:07.839985 20399 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:39063
I20260809 06:53:07.839998 20471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:39063 every 8 connection(s)
I20260809 06:53:07.841635 20399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:53:07.848412 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 20399
I20260809 06:53:07.849330 20472 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:53:07.849462 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:34863
--local_ip_for_outbound_sockets=127.10.205.65
--tserver_master_addrs=127.10.205.126:39063
--webserver_port=39551
--webserver_interface=127.10.205.65
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.205.65
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:53:07.854621 20472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42: Bootstrap starting.
I20260809 06:53:07.875859 20472 log.cc:824] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42: Log is configured to *not* fsync() on all Append() calls
I20260809 06:53:07.885320 20472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:53:07.885890 20472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42: Bootstrap complete.
I20260809 06:53:07.895670 20472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39063 } }
I20260809 06:53:07.896620 20472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 835bf24d82c2448a9d4b6fcb271f1d42, State: Initialized, Role: FOLLOWER
I20260809 06:53:07.897258 20472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39063 } }
I20260809 06:53:07.897523 20472 raft_consensus.cc:388] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:53:07.897643 20472 raft_consensus.cc:482] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:53:07.897857 20472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 1 FOLLOWER]: Advancing to term 2
I20260809 06:53:07.901994 20472 raft_consensus.cc:504] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39063 } }
I20260809 06:53:07.902536 20472 leader_election.cc:302] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 835bf24d82c2448a9d4b6fcb271f1d42; no voters:
I20260809 06:53:07.903216 20472 leader_election.cc:288] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 06:53:07.903367 20476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 06:53:07.904783 20476 raft_consensus.cc:686] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [term 2 LEADER]: Becoming Leader. State: Replica: 835bf24d82c2448a9d4b6fcb271f1d42, State: Running, Role: LEADER
I20260809 06:53:07.905441 20476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39063 } }
I20260809 06:53:07.905588 20472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:53:07.911738 20477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39063 } } }
I20260809 06:53:07.912214 20477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [sys.catalog]: This master's current role is: LEADER
I20260809 06:53:07.912853 20478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 835bf24d82c2448a9d4b6fcb271f1d42. Latest consensus state: current_term: 2 leader_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "835bf24d82c2448a9d4b6fcb271f1d42" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39063 } } }
I20260809 06:53:07.913174 20478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42 [sys.catalog]: This master's current role is: LEADER
I20260809 06:53:07.918959 20483 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:53:07.926442 20483 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:53:07.928730 20483 catalog_manager.cc:1259] Loaded cluster ID: 8e61c665285b4d129d179c9a801acfce
I20260809 06:53:07.928938 20483 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:53:07.934478 20483 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:53:07.936529 20483 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 835bf24d82c2448a9d4b6fcb271f1d42: Loaded TSK: 0
I20260809 06:53:07.938555 20483 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 06:53:08.216866 20474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:08.217163 20474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:08.217324 20474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:08.227730 20474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:08.227888 20474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:08.228127 20474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:53:08.239198 20474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.65.keytab
--principal=oryx/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:34863
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=39551
--tserver_master_addrs=127.10.205.126:39063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:08.240739 20474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:08.242084 20474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:08.257972 20500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:08.257994 20503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:08.258487 20501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:08.258818 20474 server_base.cc:1034] running on GCE node
I20260809 06:53:08.259490 20474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:08.260579 20474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:08.261855 20474 hybrid_clock.cc:648] HybridClock initialized: now 1786258388261795 us; error 54 us; skew 500 ppm
I20260809 06:53:08.262188 20474 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258388, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:53:08.269109 20474 init.cc:377] Logged in from keytab as oryx/127.10.205.65@KRBTEST.COM (short username oryx)
I20260809 06:53:08.270850 20474 webserver.cc:460] Webserver started at http://127.10.205.65:39551/ using document root <none> and password file <none>
I20260809 06:53:08.271612 20474 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:08.271792 20474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:08.277657 20474 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 06:53:08.280723 20511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:08.282243 20474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:53:08.282441 20474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "fe91c90efebf41e1802a130e99363d81"
format_stamp: "Formatted at 2026-08-09 06:53:05 on dist-test-slave-0b58"
server_key: "e4b02c20579b770cd07e4c50a049fd89"
server_key_iv: "6c118d2c29cd621872f8e83f21c81753"
server_key_version: "encryptionkey@0"
I20260809 06:53:08.283854 20474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:08.304729 20474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:08.309105 20474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:08.309420 20474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:08.310545 20474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:08.312000 20474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:08.312091 20474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:08.312304 20474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:08.312417 20474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 06:53:08.347246 20474 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:34863
I20260809 06:53:08.347347 20630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:34863 every 8 connection(s)
I20260809 06:53:08.348837 20474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:53:08.351162 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 20474
I20260809 06:53:08.351886 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:38543
--local_ip_for_outbound_sockets=127.10.205.66
--tserver_master_addrs=127.10.205.126:39063
--webserver_port=35147
--webserver_interface=127.10.205.66
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.205.66
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:08.368191 20634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:08.352081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:57347)
0809 06:53:08.353328 (+ 1247us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:08.353381 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:08.355100 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:08.356580 (+ 1480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:08.356591 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:08.357226 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:08.357756 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:08.357773 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.359411 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.359425 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:08.360844 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:08.360860 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.361972 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.361980 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:08.362283 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:08.363049 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:08.363092 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:08.367242 (+ 4150us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":960,"thread_start_us":782,"threads_started":1}
W20260809 06:53:08.369017 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:08.352019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:57347 (local address 127.10.205.126:39063)
0809 06:53:08.352914 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:08.352933 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:08.353555 (+ 622us) server_negotiation.cc:407] Connection header received
0809 06:53:08.355686 (+ 2131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:08.355699 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:08.356022 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:08.356415 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:08.357976 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.359219 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.361031 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.361707 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.361935 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:08.367750 (+ 5815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:57347: BlockingRecv error: recv got EOF from 127.10.205.65:57347 (error 108)
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":336,"threads_started":1}
W20260809 06:53:08.369083 20631 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:39063 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.205.126:39063: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:08.377712 20634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:08.369838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:49055)
0809 06:53:08.370032 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:08.370053 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:08.370163 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:08.370523 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:08.370528 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:08.370873 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:08.371009 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:08.371018 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.372059 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.372064 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:08.373017 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:08.373028 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.373737 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.373743 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:08.373921 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:08.374538 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:08.374556 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:08.377413 (+ 2857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 06:53:08.377918 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:08.369936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:49055 (local address 127.10.205.126:39063)
0809 06:53:08.370141 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:08.370146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:08.370166 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:53:08.370310 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:08.370316 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:08.370386 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:08.370497 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:08.371159 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.371905 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.373171 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.373577 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.373711 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:08.377625 (+ 3914us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:49055: BlockingRecv error: recv got EOF from 127.10.205.65:49055 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:08.387694 20634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:08.378500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:45999)
0809 06:53:08.378749 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:08.378773 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:08.378928 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:08.379266 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:08.379273 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:08.379706 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:08.379951 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:08.379965 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.381007 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.381015 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:08.382732 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:08.382747 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.383426 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.383432 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:08.383641 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:08.384229 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:08.384268 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:08.387470 (+ 3202us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106}
W20260809 06:53:08.388037 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:08.378643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:45999 (local address 127.10.205.126:39063)
0809 06:53:08.378774 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:08.378778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:08.378870 (+ 92us) server_negotiation.cc:407] Connection header received
0809 06:53:08.379040 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:08.379044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:08.379113 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:08.379190 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:08.380098 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.380848 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.382877 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.383276 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.383375 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:08.387729 (+ 4354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:45999: BlockingRecv error: recv got EOF from 127.10.205.65:45999 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 06:53:08.388199 20631 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 06:53:08.699429 20635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:08.699725 20635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:08.699908 20635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:08.707615 20635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:08.707769 20635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:08.707976 20635 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:53:08.718319 20635 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.66.keytab
--principal=oryx/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:38543
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=35147
--tserver_master_addrs=127.10.205.126:39063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:08.719841 20635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:08.721287 20635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:08.734810 20641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:08.734997 20640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:08.735009 20643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:08.736344 20635 server_base.cc:1034] running on GCE node
I20260809 06:53:08.737056 20635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:08.738102 20635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:08.739385 20635 hybrid_clock.cc:648] HybridClock initialized: now 1786258388739347 us; error 73 us; skew 500 ppm
I20260809 06:53:08.739780 20635 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258388, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:53:08.743261 20635 init.cc:377] Logged in from keytab as oryx/127.10.205.66@KRBTEST.COM (short username oryx)
I20260809 06:53:08.745007 20635 webserver.cc:460] Webserver started at http://127.10.205.66:35147/ using document root <none> and password file <none>
I20260809 06:53:08.745754 20635 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:08.745940 20635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:08.751585 20635 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:53:08.754434 20650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:08.755806 20635 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:53:08.755997 20635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "e443c1ee77494a68b73273ea6c25ba50"
format_stamp: "Formatted at 2026-08-09 06:53:06 on dist-test-slave-0b58"
server_key: "ecbe4c630e8e0e6aa91450d64bd2f0d0"
server_key_iv: "06d3a1984a2229c96b3468d538e7d3cd"
server_key_version: "encryptionkey@0"
I20260809 06:53:08.757078 20635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:08.768983 20635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:08.773348 20635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:08.773664 20635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:08.774698 20635 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:08.776096 20635 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:08.776247 20635 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:08.776464 20635 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:08.776561 20635 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:08.812484 20635 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:38543
I20260809 06:53:08.812578 20772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:38543 every 8 connection(s)
I20260809 06:53:08.814054 20635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:53:08.822852 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 20635
I20260809 06:53:08.823462 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:32895
--local_ip_for_outbound_sockets=127.10.205.67
--tserver_master_addrs=127.10.205.126:39063
--webserver_port=37235
--webserver_interface=127.10.205.67
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.205.67
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 06:53:08.830443 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:08.816845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:57627 (local address 127.10.205.126:39063)
0809 06:53:08.817065 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:08.817073 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:08.818304 (+ 1231us) server_negotiation.cc:407] Connection header received
0809 06:53:08.820169 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:08.820174 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:08.820243 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:08.820400 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:08.821912 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.822630 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.824468 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.824899 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.825049 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:08.830166 (+ 5117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:57627: BlockingRecv error: recv got EOF from 127.10.205.66:57627 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 06:53:08.831153 20775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:08.817427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:57627)
0809 06:53:08.818133 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:08.818172 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:08.819911 (+ 1739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:08.820662 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:08.820670 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:08.821184 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:08.821747 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:08.821765 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.822817 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.822823 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:08.824230 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:08.824243 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.825139 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.825146 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:08.825410 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:08.826166 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:08.826188 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:08.829972 (+ 3784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":284,"threads_started":1}
W20260809 06:53:08.831815 20773 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:39063 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.205.126:39063: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:08.842157 20775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:08.832477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:52465)
0809 06:53:08.832676 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:08.832694 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:08.832799 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:08.833118 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:08.833121 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:08.833419 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:08.833559 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:08.833566 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.834602 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.834609 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:08.836300 (+ 1691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:08.836318 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.837019 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.837028 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:08.837250 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:08.837876 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:08.837906 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:08.841803 (+ 3897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":63}
W20260809 06:53:08.842276 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:08.832597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:52465 (local address 127.10.205.126:39063)
0809 06:53:08.832798 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:08.832806 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:08.832828 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:53:08.832891 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:08.832899 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:08.832983 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:08.833087 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:08.833709 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.834450 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.836439 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.836852 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.836953 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:08.842027 (+ 5074us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:52465: BlockingRecv error: recv got EOF from 127.10.205.66:52465 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:08 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:08.853945 20775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:08.843136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:57523)
0809 06:53:08.843414 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:08.843433 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:08.843530 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:08.843940 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:08.843944 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:08.844376 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:08.844576 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:08.844587 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.846186 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.846192 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:08.847646 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:08.847660 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.848628 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.848642 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:08.848907 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:08.849661 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:08.849691 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:08.853614 (+ 3923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157}
W20260809 06:53:08.854038 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:08.843342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:57523 (local address 127.10.205.126:39063)
0809 06:53:08.843578 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:08.843586 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:08.843607 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:53:08.843668 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:08.843676 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:08.843762 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:08.843891 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:08.844740 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.846002 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.847819 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:08.848436 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:08.848568 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:08.853819 (+ 5251us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:57523: BlockingRecv error: recv got EOF from 127.10.205.66:57523 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260809 06:53:08.854360 20773 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 06:53:09.175643 20776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:09.175956 20776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:09.176057 20776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:09.183596 20776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:09.183728 20776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:09.183853 20776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:53:09.194165 20776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/krb5kdc/oryx_127.10.205.67.keytab
--principal=oryx/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:32895
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=37235
--tserver_master_addrs=127.10.205.126:39063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:09.195506 20776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:09.196879 20776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:09.210711 20781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:09.210747 20783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:09.210945 20785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:09.211666 20776 server_base.cc:1034] running on GCE node
I20260809 06:53:09.212445 20776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:09.213514 20776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:09.214771 20776 hybrid_clock.cc:648] HybridClock initialized: now 1786258389214725 us; error 37 us; skew 500 ppm
I20260809 06:53:09.215117 20776 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:53:09 dist-test-slave-0b58 krb5kdc[19838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258389, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:53:09.218624 20776 init.cc:377] Logged in from keytab as oryx/127.10.205.67@KRBTEST.COM (short username oryx)
I20260809 06:53:09.220147 20776 webserver.cc:460] Webserver started at http://127.10.205.67:37235/ using document root <none> and password file <none>
I20260809 06:53:09.220968 20776 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:09.221091 20776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:09.226665 20776 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 06:53:09.229478 20792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:09.230857 20776 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:53:09.231036 20776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "d4fea92aabf2424a80b67c8bafddf2a8"
format_stamp: "Formatted at 2026-08-09 06:53:06 on dist-test-slave-0b58"
server_key: "66f7dcb27871919432718e2dcb7dd7b9"
server_key_iv: "8f5ed6bdff0ee02bb19e7304910e56f2"
server_key_version: "encryptionkey@0"
I20260809 06:53:09.232028 20776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:09.242761 20776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:09.246941 20776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:09.247238 20776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:09.248324 20776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:09.249697 20776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:09.249836 20776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:09.249976 20776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:09.250078 20776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:09.284665 20776 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:32895
I20260809 06:53:09.284761 20911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:32895 every 8 connection(s)
I20260809 06:53:09.286227 20776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:53:09.287344 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 20776
Aug 09 06:53:09 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:09 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 06:53:09.305125 20915 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:09.289553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:36831 (local address 127.10.205.126:39063)
0809 06:53:09.290100 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:09.290106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:09.292348 (+ 2242us) server_negotiation.cc:407] Connection header received
0809 06:53:09.293098 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:09.293103 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:09.294054 (+ 951us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:09.294164 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:09.295941 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.297124 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.298717 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.299189 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.299284 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:09.304796 (+ 5512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:36831: BlockingRecv error: recv got EOF from 127.10.205.67:36831 (error 108)
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":272,"threads_started":1}
I20260809 06:53:09.305848 20633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:09.288535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59516 (local address 127.10.205.126:39063)
0809 06:53:09.288818 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:09.288828 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:09.290541 (+ 1713us) server_negotiation.cc:407] Connection header received
0809 06:53:09.290744 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:09.290750 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:09.290858 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:09.290975 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:09.293156 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.293893 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.295129 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.295730 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.295894 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:09.298787 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:09.298804 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:09.298819 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:09.298856 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:09.302532 (+ 3676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:09.303247 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:09.303254 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:09.303261 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:09.303441 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:09.303853 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:09.303857 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:09.303859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:09.304378 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:09.304742 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:09.305149 (+ 407us) server_negotiation.cc:299] Negotiation successful
0809 06:53:09.305565 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 06:53:09.305896 20916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:09.290058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:36831)
0809 06:53:09.290954 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:09.291001 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:09.292841 (+ 1840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:09.294438 (+ 1597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:09.294447 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:09.294950 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:09.295728 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:09.295753 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.297291 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.297304 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:09.298527 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:09.298539 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.299445 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.299454 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:09.299741 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:09.300368 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:09.300401 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:09.304537 (+ 4136us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":341,"threads_started":1}
W20260809 06:53:09.306754 20912 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:39063 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.205.126:39063: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Aug 09 06:53:09 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:09 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:09.314996 20916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:09.307360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:58433)
0809 06:53:09.307571 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:09.307593 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:09.307694 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:09.308028 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:09.308032 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:09.308484 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:09.308673 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:09.308682 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.309886 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.309891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:09.310802 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:09.310813 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.311441 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.311445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:09.311570 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:09.312092 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:09.312108 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:09.314802 (+ 2694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":84}
W20260809 06:53:09.315202 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:09.307502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:58433 (local address 127.10.205.126:39063)
0809 06:53:09.307639 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:09.307643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:09.307658 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:53:09.307804 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:09.307808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:09.307894 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:09.307967 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:09.308813 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.309736 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.310926 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.311316 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.311407 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:09.314986 (+ 3579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:58433: BlockingRecv error: recv got EOF from 127.10.205.67:58433 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 09 06:53:09 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:09 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:09.323482 20916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:09.315717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:40871)
0809 06:53:09.315885 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:09.315907 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:09.316009 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:09.316327 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:09.316330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:09.316581 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:09.316793 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:09.316808 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.317717 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.317720 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:09.318601 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:09.318611 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.319309 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.319313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:09.319432 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:09.319980 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:09.319996 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:09.323162 (+ 3166us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 06:53:09.323807 20912 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 06:53:09.323912 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:09.315822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:40871 (local address 127.10.205.126:39063)
0809 06:53:09.316046 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:09.316050 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:09.316064 (+ 14us) server_negotiation.cc:407] Connection header received
0809 06:53:09.316102 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:09.316105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:09.316155 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:09.316229 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:09.316921 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.317595 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.318742 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.319171 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.319264 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:09.323351 (+ 4087us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:40871: BlockingRecv error: recv got EOF from 127.10.205.67:40871 (error 108)
Metrics: {"server-negotiator.queue_time_us":135}
Aug 09 06:53:09 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:09 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:09.398473 20917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:09.388909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:33157)
0809 06:53:09.389461 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:09.389477 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:09.389593 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:09.389915 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:09.389919 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:09.390382 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:09.390576 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:09.390585 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.391651 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.391656 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:09.393107 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:09.393127 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.394259 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.394265 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:09.394470 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:09.395218 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:09.395236 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:09.398117 (+ 2881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":289,"threads_started":1}
W20260809 06:53:09.398564 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:09.389070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:33157 (local address 127.10.205.126:39063)
0809 06:53:09.389249 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:09.389254 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:09.389555 (+ 301us) server_negotiation.cc:407] Connection header received
0809 06:53:09.389694 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:09.389698 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:09.389761 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:09.389854 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:09.390704 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.391474 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.393333 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.394047 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.394209 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:09.398328 (+ 4119us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:33157: BlockingRecv error: recv got EOF from 127.10.205.65:33157 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 06:53:09 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:09 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:09.863922 20918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:09.855069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:37019)
0809 06:53:09.855636 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:09.855672 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:09.855814 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:09.856215 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:09.856218 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:09.856896 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:09.857097 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:09.857106 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.858082 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.858085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:09.859030 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:09.859041 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.859748 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.859752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:09.859869 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:09.860548 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:09.860565 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:09.863584 (+ 3019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":283,"threads_started":1}
W20260809 06:53:09.864075 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:09.855192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:37019 (local address 127.10.205.126:39063)
0809 06:53:09.855409 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:09.855416 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:09.855771 (+ 355us) server_negotiation.cc:407] Connection header received
0809 06:53:09.855928 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:09.855935 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:09.856034 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:09.856154 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:09.857230 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.857956 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.859147 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:09.859583 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:09.859676 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:09.863802 (+ 4126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:37019: BlockingRecv error: recv got EOF from 127.10.205.66:37019 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 06:53:10 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:10 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:10.333355 20919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:10.324449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:58551)
0809 06:53:10.324970 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:10.324987 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:10.325146 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:10.325504 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:10.325509 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:10.326018 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:10.326236 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:10.326246 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:10.327289 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:10.327295 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:10.328336 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:10.328348 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:10.329134 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:10.329139 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:10.329316 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:10.329900 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:10.329918 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:10.333009 (+ 3091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":272,"threads_started":1}
W20260809 06:53:10.333472 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:10.324550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:58551 (local address 127.10.205.126:39063)
0809 06:53:10.324780 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:10.324788 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:10.325074 (+ 286us) server_negotiation.cc:407] Connection header received
0809 06:53:10.325285 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:10.325290 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:10.325360 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:10.325469 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:10.326388 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:10.327129 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:10.328478 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:10.328932 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:10.329082 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:10.333236 (+ 4154us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:58551: BlockingRecv error: recv got EOF from 127.10.205.67:58551 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 09 06:53:10 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:10 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:10.411226 20920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:10.399536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:34923)
0809 06:53:10.400108 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:10.400125 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:10.400240 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:10.400588 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:10.400591 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:10.400977 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:10.401147 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:10.401156 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:10.402142 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:10.402146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:10.403056 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:10.403067 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:10.403723 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:10.403727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:10.403835 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:10.408091 (+ 4256us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:10.408111 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:10.410971 (+ 2860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":324,"threads_started":1}
W20260809 06:53:10.411448 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:10.399672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:34923 (local address 127.10.205.126:39063)
0809 06:53:10.399878 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:10.399883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:10.400207 (+ 324us) server_negotiation.cc:407] Connection header received
0809 06:53:10.400377 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:10.400382 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:10.400442 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:10.400527 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:10.401281 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:10.402016 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:10.403185 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:10.403586 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:10.403677 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:10.411198 (+ 7521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:34923: BlockingRecv error: recv got EOF from 127.10.205.65:34923 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 06:53:10 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:10 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:10.873881 20921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:10.864835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:37065)
0809 06:53:10.865435 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:10.865454 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:10.865580 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:10.865909 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:10.865912 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:10.866364 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:10.866554 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:10.866564 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:10.867549 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:10.867552 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:10.868584 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:10.868597 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:10.869342 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:10.869346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:10.869539 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:10.870510 (+ 971us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:10.870532 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:10.873624 (+ 3092us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":340,"threads_started":1}
W20260809 06:53:10.874042 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:10.864929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:37065 (local address 127.10.205.126:39063)
0809 06:53:10.865104 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:10.865108 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:10.865532 (+ 424us) server_negotiation.cc:407] Connection header received
0809 06:53:10.865682 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:10.865686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:10.865765 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:10.865850 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:10.866684 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:10.867412 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:10.868713 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:10.869189 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:10.869326 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:10.873854 (+ 4528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:37065: BlockingRecv error: recv got EOF from 127.10.205.66:37065 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 06:53:11 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:11 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:11.342796 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:11.334306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:60021)
0809 06:53:11.334882 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:11.334899 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:11.335013 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:11.335382 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:11.335387 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:11.335841 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:11.336083 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:11.336094 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:11.337220 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:11.337227 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:11.338127 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:11.338138 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:11.338909 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:11.338915 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:11.339094 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:11.339652 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:11.339672 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:11.342534 (+ 2862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":332,"threads_started":1}
W20260809 06:53:11.343005 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:11.334472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:60021 (local address 127.10.205.126:39063)
0809 06:53:11.334652 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:11.334660 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:11.334983 (+ 323us) server_negotiation.cc:407] Connection header received
0809 06:53:11.335145 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:11.335151 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:11.335228 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:11.335342 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:11.336230 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:11.337060 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:11.338276 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:11.338736 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:11.338884 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:11.342747 (+ 3863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:60021: BlockingRecv error: recv got EOF from 127.10.205.67:60021 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 06:53:11 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:11 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:11.420974 20923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:11.412258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:51005)
0809 06:53:11.412790 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:11.412827 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:11.412946 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:11.413232 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:11.413236 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:11.413577 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:11.413740 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:11.413748 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:11.414770 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:11.414774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:11.415683 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:11.415694 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:11.416390 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:11.416394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:11.416517 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:11.417215 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:11.417233 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:11.420570 (+ 3337us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":269,"threads_started":1}
W20260809 06:53:11.421032 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:11.412441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:51005 (local address 127.10.205.126:39063)
0809 06:53:11.412673 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:11.412680 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:11.412911 (+ 231us) server_negotiation.cc:407] Connection header received
0809 06:53:11.413032 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:11.413036 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:11.413098 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:11.413178 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:11.413888 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:11.414633 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:11.415809 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:11.416234 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:11.416349 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:11.420766 (+ 4417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:51005: BlockingRecv error: recv got EOF from 127.10.205.65:51005 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 09 06:53:11 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:11 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:11.883738 20924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:11.875178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:47147)
0809 06:53:11.875711 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:11.875728 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:11.875853 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:11.876203 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:11.876206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:11.876687 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:11.876932 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:11.876946 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:11.878099 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:11.878105 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:11.879013 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:11.879024 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:11.879757 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:11.879763 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:11.879957 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:11.880613 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:11.880631 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:11.883476 (+ 2845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":304,"threads_started":1}
W20260809 06:53:11.883953 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:11.875276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:47147 (local address 127.10.205.126:39063)
0809 06:53:11.875475 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:11.875482 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:11.875828 (+ 346us) server_negotiation.cc:407] Connection header received
0809 06:53:11.875961 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:11.875965 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:11.876065 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:11.876156 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:11.877075 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:11.877942 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:11.879165 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:11.879595 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:11.879738 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:11.883687 (+ 3949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:47147: BlockingRecv error: recv got EOF from 127.10.205.66:47147 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 06:53:12 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:12 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:12.352403 20925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:12.343869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:40589)
0809 06:53:12.344423 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:12.344447 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:12.344598 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:12.344997 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:12.345002 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:12.345397 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:12.345574 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:12.345582 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:12.346597 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:12.346601 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:12.347505 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:12.347514 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:12.348279 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:12.348286 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:12.348475 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:12.349140 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:12.349158 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:12.352017 (+ 2859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":288,"threads_started":1}
W20260809 06:53:12.352581 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:12.343978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:40589 (local address 127.10.205.126:39063)
0809 06:53:12.344186 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:12.344192 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:12.344544 (+ 352us) server_negotiation.cc:407] Connection header received
0809 06:53:12.344720 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:12.344724 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:12.344823 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:12.344931 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:12.345716 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:12.346470 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:12.347655 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:12.348085 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:12.348229 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:12.352313 (+ 4084us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:40589: BlockingRecv error: recv got EOF from 127.10.205.67:40589 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 09 06:53:12 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:12 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:12.431259 20926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:12.422143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:51161)
0809 06:53:12.422719 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:12.422735 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:12.422857 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:12.423279 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:12.423301 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:12.423707 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:12.423866 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:12.423876 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:12.425030 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:12.425038 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:12.426038 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:12.426050 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:12.426833 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:12.426839 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:12.427020 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:12.427625 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:12.427643 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:12.430994 (+ 3351us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":361,"threads_started":1}
W20260809 06:53:12.431559 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:12.422198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:51161 (local address 127.10.205.126:39063)
0809 06:53:12.422383 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:12.422388 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:12.422832 (+ 444us) server_negotiation.cc:407] Connection header received
0809 06:53:12.422965 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:12.422969 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:12.423055 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:12.423190 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:12.424045 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:12.424884 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:12.426223 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:12.426674 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:12.426826 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:12.431248 (+ 4422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:51161: BlockingRecv error: recv got EOF from 127.10.205.65:51161 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 06:53:12 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:12 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:12.893210 20927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:12.884672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:42519)
0809 06:53:12.885181 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:12.885198 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:12.885327 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:12.885661 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:12.885665 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:12.886061 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:12.886235 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:12.886244 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:12.887228 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:12.887231 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:12.888421 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:12.888435 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:12.889084 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:12.889088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:12.889213 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:12.889838 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:12.889857 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:12.892834 (+ 2977us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":304,"threads_started":1}
W20260809 06:53:12.893442 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:12.884760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:42519 (local address 127.10.205.126:39063)
0809 06:53:12.885006 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:12.885012 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:12.885295 (+ 283us) server_negotiation.cc:407] Connection header received
0809 06:53:12.885429 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:12.885433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:12.885526 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:12.885608 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:12.886380 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:12.887090 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:12.888547 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:12.888957 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:12.889051 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:12.893061 (+ 4010us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:42519: BlockingRecv error: recv got EOF from 127.10.205.66:42519 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 06:53:13 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:13 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:13.366605 20928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:13.353656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:51593)
0809 06:53:13.354181 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:13.354196 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:13.354316 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:13.354683 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:13.354686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:13.355063 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:13.355212 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:13.355220 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:13.356206 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:13.356210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:13.357271 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:13.357284 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:13.358095 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:13.358101 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:13.358312 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:13.363301 (+ 4989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:13.363320 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:13.366242 (+ 2922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":293,"threads_started":1}
W20260809 06:53:13.366770 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:13.353766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:51593 (local address 127.10.205.126:39063)
0809 06:53:13.353957 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:13.353962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:13.354271 (+ 309us) server_negotiation.cc:407] Connection header received
0809 06:53:13.354465 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:13.354471 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:13.354551 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:13.354635 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:13.355361 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:13.356085 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:13.357413 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:13.357924 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:13.358058 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:13.366501 (+ 8443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:51593: BlockingRecv error: recv got EOF from 127.10.205.67:51593 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 06:53:13 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:13 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:13.440645 20929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:13.432308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:44893)
0809 06:53:13.432915 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:13.432932 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:13.433047 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:13.433349 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:13.433352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:13.433765 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:13.433946 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:13.433955 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:13.434958 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:13.434963 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:13.435942 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:13.435955 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:13.436742 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:13.436747 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:13.436881 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:13.437461 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:13.437479 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:13.440384 (+ 2905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":272,"threads_started":1}
W20260809 06:53:13.440810 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:13.432364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:44893 (local address 127.10.205.126:39063)
0809 06:53:13.432531 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:13.432539 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:13.433012 (+ 473us) server_negotiation.cc:407] Connection header received
0809 06:53:13.433142 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:13.433146 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:13.433208 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:13.433300 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:13.434073 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:13.434804 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:13.436143 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:13.436606 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:13.436701 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:13.440576 (+ 3875us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:44893: BlockingRecv error: recv got EOF from 127.10.205.65:44893 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 06:53:13 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:13 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:13.903019 20930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:13.894322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:42579)
0809 06:53:13.894959 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:13.894983 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:13.895126 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:13.895592 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:13.895599 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:13.896238 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:13.896530 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:13.896547 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:13.897554 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:13.897557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:13.898478 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:13.898489 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:13.899131 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:13.899135 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:13.899256 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:13.899935 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:13.899954 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:13.902765 (+ 2811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":408,"threads_started":1}
W20260809 06:53:13.903184 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:13.894547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:42579 (local address 127.10.205.126:39063)
0809 06:53:13.894710 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:13.894714 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:13.895148 (+ 434us) server_negotiation.cc:407] Connection header received
0809 06:53:13.895273 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:13.895279 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:13.895395 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:13.895505 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:13.896691 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:13.897432 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:13.898609 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:13.899009 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:13.899099 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:13.902949 (+ 3850us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:42579: BlockingRecv error: recv got EOF from 127.10.205.66:42579 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 09 06:53:14 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:14 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:14.376353 20931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:14.367670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:55425)
0809 06:53:14.368429 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:14.368451 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:14.368620 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:14.369033 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:14.369039 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:14.369579 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:14.369823 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:14.369836 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:14.370863 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:14.370867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:14.371795 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:14.371807 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:14.372533 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:14.372538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:14.372666 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:14.373247 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:14.373264 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:14.376047 (+ 2783us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":372,"threads_started":1}
W20260809 06:53:14.376612 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:14.367829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:55425 (local address 127.10.205.126:39063)
0809 06:53:14.368056 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:14.368063 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:14.368535 (+ 472us) server_negotiation.cc:407] Connection header received
0809 06:53:14.368783 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:14.368787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:14.368858 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:14.368948 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:14.369983 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:14.370707 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:14.371924 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:14.372391 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:14.372488 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:14.376239 (+ 3751us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:55425: BlockingRecv error: recv got EOF from 127.10.205.67:55425 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 09 06:53:14 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:14 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:14.450248 20932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:14.441669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:47317)
0809 06:53:14.442260 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:14.442277 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:14.442457 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:14.442861 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:14.442865 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:14.443253 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:14.443427 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:14.443436 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:14.444528 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:14.444532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:14.445428 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:14.445440 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:14.446426 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:14.446431 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:14.446569 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:14.447208 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:14.447225 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:14.450029 (+ 2804us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":336,"threads_started":1}
W20260809 06:53:14.450541 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:14.441740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:47317 (local address 127.10.205.126:39063)
0809 06:53:14.441955 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:14.441963 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:14.442379 (+ 416us) server_negotiation.cc:407] Connection header received
0809 06:53:14.442608 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:14.442614 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:14.442693 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:14.442809 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:14.443557 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:14.444408 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:14.445652 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:14.446222 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:14.446352 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:14.450259 (+ 3907us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:47317: BlockingRecv error: recv got EOF from 127.10.205.65:47317 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 09 06:53:14 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:14 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:14.912631 20933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:14.904082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:48445)
0809 06:53:14.904701 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:14.904725 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:14.904878 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:14.905337 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:14.905342 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:14.905962 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:14.906198 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:14.906211 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:14.907393 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:14.907397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:14.908308 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:14.908319 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:14.908973 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:14.908977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:14.909096 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:14.909694 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:14.909711 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:14.912427 (+ 2716us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":345,"threads_started":1}
W20260809 06:53:14.912840 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:14.904207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:48445 (local address 127.10.205.126:39063)
0809 06:53:14.904409 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:14.904413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:14.904821 (+ 408us) server_negotiation.cc:407] Connection header received
0809 06:53:14.905051 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:14.905056 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:14.905165 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:14.905265 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:14.906375 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:14.907264 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:14.908438 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:14.908843 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:14.908932 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:14.912604 (+ 3672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:48445: BlockingRecv error: recv got EOF from 127.10.205.66:48445 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 09 06:53:15 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:15 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:15.385874 20934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:15.377437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:34163)
0809 06:53:15.377997 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:15.378014 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:15.378128 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:15.378425 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:15.378428 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:15.378809 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:15.378972 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:15.378980 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:15.379968 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:15.379972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:15.380946 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:15.380958 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:15.381657 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:15.381661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:15.381776 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:15.382362 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:15.382379 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:15.385550 (+ 3171us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":316,"threads_started":1}
W20260809 06:53:15.386016 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:15.377558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:34163 (local address 127.10.205.126:39063)
0809 06:53:15.377724 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:15.377729 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:15.378088 (+ 359us) server_negotiation.cc:407] Connection header received
0809 06:53:15.378223 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:15.378227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:15.378296 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:15.378376 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:15.379099 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:15.379839 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:15.381075 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:15.381510 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:15.381608 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:15.385748 (+ 4140us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:34163: BlockingRecv error: recv got EOF from 127.10.205.67:34163 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 06:53:15 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:15 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:15.459964 20935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:15.451221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:33707)
0809 06:53:15.451898 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:15.451916 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:15.452033 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:15.452384 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:15.452388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:15.452820 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:15.452991 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:15.453000 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:15.454099 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:15.454103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:15.455038 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:15.455048 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:15.455751 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:15.455755 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:15.455871 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:15.456517 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:15.456535 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:15.459691 (+ 3156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":324,"threads_started":1}
W20260809 06:53:15.460148 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:15.451340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:33707 (local address 127.10.205.126:39063)
0809 06:53:15.451524 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:15.451529 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:15.451992 (+ 463us) server_negotiation.cc:407] Connection header received
0809 06:53:15.452133 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:15.452137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:15.452200 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:15.452353 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:15.453119 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:15.453971 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:15.455165 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:15.455613 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:15.455707 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:15.459903 (+ 4196us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:33707: BlockingRecv error: recv got EOF from 127.10.205.65:33707 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 06:53:15 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:15 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:15.921849 20936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:15.913548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:37407)
0809 06:53:15.914118 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:15.914134 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:15.914250 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:15.914582 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:15.914585 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:15.915019 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:15.915187 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:15.915196 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:15.916153 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:15.916156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:15.917099 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:15.917110 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:15.917762 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:15.917766 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:15.917884 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:15.918468 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:15.918485 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:15.921489 (+ 3004us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":286,"threads_started":1}
W20260809 06:53:15.921988 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:15.913659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:37407 (local address 127.10.205.126:39063)
0809 06:53:15.913925 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:15.913932 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:15.914220 (+ 288us) server_negotiation.cc:407] Connection header received
0809 06:53:15.914359 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:15.914363 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:15.914453 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:15.914534 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:15.915322 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:15.916030 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:15.917219 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:15.917629 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:15.917720 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:15.921714 (+ 3994us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:37407: BlockingRecv error: recv got EOF from 127.10.205.66:37407 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 09 06:53:16 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:16 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:16.395937 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:16.386949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:50257)
0809 06:53:16.387613 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:16.387631 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:16.387751 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:16.388138 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:16.388141 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:16.388594 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:16.388764 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:16.388772 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:16.389787 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:16.389791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:16.390738 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:16.390751 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:16.391704 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:16.391711 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:16.391909 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:16.392682 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:16.392700 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:16.395684 (+ 2984us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":301,"threads_started":1}
W20260809 06:53:16.396170 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:16.387076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:50257 (local address 127.10.205.126:39063)
0809 06:53:16.387247 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:16.387252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:16.387707 (+ 455us) server_negotiation.cc:407] Connection header received
0809 06:53:16.387879 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:16.387883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:16.387995 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:16.388088 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:16.388905 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:16.389623 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:16.390888 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:16.391517 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:16.391648 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:16.395934 (+ 4286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:50257: BlockingRecv error: recv got EOF from 127.10.205.67:50257 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 06:53:16 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:16 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:16.470597 20938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:16.461343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:54477)
0809 06:53:16.461935 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:16.461953 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:16.462119 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:16.462470 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:16.462474 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:16.462906 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:16.463065 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:16.463074 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:16.464115 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:16.464121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:16.465451 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:16.465464 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:16.466564 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:16.466578 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:16.466743 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:16.467430 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:16.467450 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:16.470234 (+ 2784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":322,"threads_started":1}
W20260809 06:53:16.470726 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:16.461440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:54477 (local address 127.10.205.126:39063)
0809 06:53:16.461707 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:16.461715 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:16.462047 (+ 332us) server_negotiation.cc:407] Connection header received
0809 06:53:16.462260 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:16.462264 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:16.462330 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:16.462447 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:16.463219 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:16.463960 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:16.465592 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:16.466047 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:16.466208 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:16.470481 (+ 4273us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:54477: BlockingRecv error: recv got EOF from 127.10.205.65:54477 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 09 06:53:16 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:16 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:16.932722 20939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:16.923041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:48705)
0809 06:53:16.923649 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:16.923666 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:16.923846 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:16.924233 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:16.924238 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:16.924730 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:16.924900 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:16.924909 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:16.926230 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:16.926236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:16.927679 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:16.927693 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:16.928599 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:16.928604 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:16.928730 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:16.929362 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:16.929380 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:16.932417 (+ 3037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":324,"threads_started":1}
W20260809 06:53:16.932973 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:16.923180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:48705 (local address 127.10.205.126:39063)
0809 06:53:16.923433 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:16.923443 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:16.923769 (+ 326us) server_negotiation.cc:407] Connection header received
0809 06:53:16.923985 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:16.923991 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:16.924083 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:16.924196 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:16.925066 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:16.926032 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:16.927843 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:16.928418 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:16.928534 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:16.932737 (+ 4203us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:48705: BlockingRecv error: recv got EOF from 127.10.205.66:48705 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 09 06:53:17 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:17 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:17.405105 20940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:17.396881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:56381)
0809 06:53:17.397457 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:17.397474 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:17.397590 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:17.397887 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:17.397891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:17.398292 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:17.398446 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:17.398454 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:17.399401 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:17.399404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:17.400406 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:17.400418 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:17.401109 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:17.401113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:17.401222 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:17.401816 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:17.401832 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:17.404753 (+ 2921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":314,"threads_started":1}
W20260809 06:53:17.405314 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:17.396999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:56381 (local address 127.10.205.126:39063)
0809 06:53:17.397197 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:17.397201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:17.397553 (+ 352us) server_negotiation.cc:407] Connection header received
0809 06:53:17.397691 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:17.397695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:17.397758 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:17.397841 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:17.398571 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:17.399270 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:17.400533 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:17.400956 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:17.401048 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:17.405018 (+ 3970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:56381: BlockingRecv error: recv got EOF from 127.10.205.67:56381 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 06:53:17 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:17 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:17.480242 20941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:17.471612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:40645)
0809 06:53:17.472181 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:17.472197 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:17.472396 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:17.472712 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:17.472716 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:17.473120 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:17.473306 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:17.473315 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:17.474305 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:17.474309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:17.475271 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:17.475292 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:17.475965 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:17.475969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:17.476090 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:17.476746 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:17.476763 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:17.479989 (+ 3226us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":308,"threads_started":1}
W20260809 06:53:17.480470 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:17.471670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:40645 (local address 127.10.205.126:39063)
0809 06:53:17.471846 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:17.471850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:17.472330 (+ 480us) server_negotiation.cc:407] Connection header received
0809 06:53:17.472520 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:17.472525 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:17.472588 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:17.472672 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:17.473440 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:17.474175 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:17.475410 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:17.475830 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:17.475922 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:17.480153 (+ 4231us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:40645: BlockingRecv error: recv got EOF from 127.10.205.65:40645 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 06:53:17 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:17 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:17.942821 20942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:17.933898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:37239)
0809 06:53:17.934550 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:17.934571 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:17.934748 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:17.935167 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:17.935175 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:17.935651 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:17.935887 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:17.935897 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:17.937112 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:17.937116 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:17.938055 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:17.938067 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:17.938789 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:17.938793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:17.938915 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:17.939517 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:17.939535 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:17.942428 (+ 2893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":369,"threads_started":1}
W20260809 06:53:17.942898 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:17.933934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:37239 (local address 127.10.205.126:39063)
0809 06:53:17.934189 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:17.934199 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:17.934700 (+ 501us) server_negotiation.cc:407] Connection header received
0809 06:53:17.934878 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:17.934885 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:17.935000 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:17.935112 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:17.936044 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:17.936989 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:17.938190 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:17.938650 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:17.938744 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:17.942650 (+ 3906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:37239: BlockingRecv error: recv got EOF from 127.10.205.66:37239 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 09 06:53:18 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:18 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:18.420105 20944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:18.406200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:40967)
0809 06:53:18.406799 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:18.406815 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:18.406991 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:18.407352 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:18.407357 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:18.407802 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:18.407965 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:18.407973 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:18.409093 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:18.409101 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:18.410046 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:18.410057 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:18.410785 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:18.410791 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:18.410980 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:18.416655 (+ 5675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:18.416675 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:18.419715 (+ 3040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":317,"threads_started":1}
W20260809 06:53:18.420194 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:18.406242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:40967 (local address 127.10.205.126:39063)
0809 06:53:18.406506 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:18.406514 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:18.406921 (+ 407us) server_negotiation.cc:407] Connection header received
0809 06:53:18.407133 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:18.407141 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:18.407210 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:18.407325 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:18.408110 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:18.408954 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:18.410196 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:18.410624 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:18.410765 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:18.419960 (+ 9195us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:40967: BlockingRecv error: recv got EOF from 127.10.205.67:40967 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 06:53:18 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:18 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:18.491464 20945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:18.481463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:56225)
0809 06:53:18.481989 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:18.482005 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:18.482159 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:18.482511 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:18.482516 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:18.482936 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:18.483082 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:18.483091 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:18.484495 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:18.484501 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:18.485908 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:18.485929 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:18.486935 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:18.486941 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:18.487129 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:18.487976 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:18.488017 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:18.491148 (+ 3131us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":311,"threads_started":1}
W20260809 06:53:18.491753 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:18.481564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:56225 (local address 127.10.205.126:39063)
0809 06:53:18.481799 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:18.481806 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:18.482092 (+ 286us) server_negotiation.cc:407] Connection header received
0809 06:53:18.482305 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:18.482309 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:18.482369 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:18.482472 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:18.483246 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:18.484335 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:18.486125 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:18.486732 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:18.486860 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:18.491364 (+ 4504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:56225: BlockingRecv error: recv got EOF from 127.10.205.65:56225 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 09 06:53:18 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:18 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:18.953483 20946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:18.943944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:38183)
0809 06:53:18.944494 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:18.944511 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:18.944622 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:18.944918 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:18.944921 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:18.945282 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:18.945426 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:18.945434 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:18.946439 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:18.946443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:18.947497 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:18.947518 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:18.948642 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:18.948650 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:18.948921 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:18.949788 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:18.949822 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:18.953261 (+ 3439us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":340,"threads_started":1}
W20260809 06:53:18.953684 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:18.944035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:38183 (local address 127.10.205.126:39063)
0809 06:53:18.944211 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:18.944215 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:18.944584 (+ 369us) server_negotiation.cc:407] Connection header received
0809 06:53:18.944723 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:18.944727 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:18.944789 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:18.944880 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:18.945554 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:18.946319 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:18.947717 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:18.948402 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:18.948562 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:18.953450 (+ 4888us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:38183: BlockingRecv error: recv got EOF from 127.10.205.66:38183 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 06:53:19 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:19 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:19.429553 20947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:19.421221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:36971)
0809 06:53:19.421797 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:19.421815 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:19.421996 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:19.422296 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:19.422300 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:19.422678 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:19.422826 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:19.422835 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:19.423808 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:19.423812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:19.424812 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:19.424824 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:19.425462 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:19.425466 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:19.425688 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:19.426357 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:19.426374 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:19.429207 (+ 2833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":331,"threads_started":1}
W20260809 06:53:19.429708 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:19.421379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:36971 (local address 127.10.205.126:39063)
0809 06:53:19.421599 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:19.421603 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:19.421932 (+ 329us) server_negotiation.cc:407] Connection header received
0809 06:53:19.422089 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:19.422093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:19.422155 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:19.422234 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:19.422957 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:19.423679 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:19.424933 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:19.425321 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:19.425412 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:19.429464 (+ 4052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:36971: BlockingRecv error: recv got EOF from 127.10.205.67:36971 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Aug 09 06:53:19 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:19 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:19.501103 20948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:19.492502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:59457)
0809 06:53:19.493065 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:19.493083 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:19.493202 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:19.493516 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:19.493520 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:19.493949 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:19.494131 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:19.494140 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:19.495144 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:19.495149 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:19.496037 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:19.496050 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:19.497054 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:19.497059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:19.497208 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:19.497807 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:19.497826 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:19.500852 (+ 3026us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":320,"threads_started":1}
W20260809 06:53:19.501363 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:19.492601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:59457 (local address 127.10.205.126:39063)
0809 06:53:19.492797 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:19.492802 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:19.493158 (+ 356us) server_negotiation.cc:407] Connection header received
0809 06:53:19.493300 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:19.493304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:19.493381 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:19.493460 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:19.494255 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:19.495017 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:19.496163 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:19.496827 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:19.496923 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:19.501067 (+ 4144us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:59457: BlockingRecv error: recv got EOF from 127.10.205.65:59457 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 06:53:19 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:19 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:19.963629 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:19.954510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:56767)
0809 06:53:19.955017 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:19.955034 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:19.955204 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:19.955591 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:19.955595 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:19.956040 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:19.956233 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:19.956243 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:19.957284 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:19.957289 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:19.958257 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:19.958269 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:19.959084 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:19.959090 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:19.959293 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:19.960021 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:19.960047 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:19.963249 (+ 3202us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":266,"threads_started":1}
W20260809 06:53:19.963699 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:19.954596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:56767 (local address 127.10.205.126:39063)
0809 06:53:19.954834 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:19.954841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:19.955130 (+ 289us) server_negotiation.cc:407] Connection header received
0809 06:53:19.955328 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:19.955333 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:19.955425 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:19.955560 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:19.956400 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:19.957149 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:19.958404 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:19.958919 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:19.959073 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:19.963440 (+ 4367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:56767: BlockingRecv error: recv got EOF from 127.10.205.66:56767 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 09 06:53:20 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:20 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:20.440001 20950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:20.430830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:54241)
0809 06:53:20.431385 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:20.431402 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:20.431589 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:20.431937 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:20.431942 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:20.432436 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:20.432613 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:20.432622 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:20.433871 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:20.433875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:20.435243 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:20.435260 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:20.435964 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:20.435969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:20.436095 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:20.436818 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:20.436835 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:20.439567 (+ 2732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":282,"threads_started":1}
W20260809 06:53:20.440121 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:20.430922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:54241 (local address 127.10.205.126:39063)
0809 06:53:20.431160 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:20.431169 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:20.431496 (+ 327us) server_negotiation.cc:407] Connection header received
0809 06:53:20.431718 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:20.431725 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:20.431796 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:20.431903 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:20.432809 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:20.433733 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:20.435401 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:20.435815 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:20.435913 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:20.439780 (+ 3867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:54241: BlockingRecv error: recv got EOF from 127.10.205.67:54241 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 09 06:53:20 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:20 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:20.511025 20951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:20.502066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:57623)
0809 06:53:20.502599 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:20.502615 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:20.502779 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:20.503153 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:20.503158 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:20.503622 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:20.503799 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:20.503809 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:20.504963 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:20.504971 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:20.506026 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:20.506039 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:20.507026 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:20.507033 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:20.507201 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:20.507956 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:20.507979 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:20.510753 (+ 2774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":313,"threads_started":1}
W20260809 06:53:20.511195 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:20.502157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:57623 (local address 127.10.205.126:39063)
0809 06:53:20.502376 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:20.502386 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:20.502712 (+ 326us) server_negotiation.cc:407] Connection header received
0809 06:53:20.502921 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:20.502928 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:20.503009 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:20.503115 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:20.503956 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:20.504816 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:20.506178 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:20.506857 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:20.506981 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:20.510957 (+ 3976us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:57623: BlockingRecv error: recv got EOF from 127.10.205.65:57623 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 06:53:20 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:20 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:20.973775 20952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:20.964699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:57047)
0809 06:53:20.965257 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:20.965283 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:20.965413 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:20.965725 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:20.965729 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:20.966134 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:20.966310 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:20.966320 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:20.967644 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:20.967648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:20.968652 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:20.968683 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:20.969628 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:20.969636 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:20.969861 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:20.970614 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:20.970640 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:20.973531 (+ 2891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":333,"threads_started":1}
W20260809 06:53:20.973958 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:20.964772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:57047 (local address 127.10.205.126:39063)
0809 06:53:20.964972 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:20.964977 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:20.965368 (+ 391us) server_negotiation.cc:407] Connection header received
0809 06:53:20.965511 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:20.965516 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:20.965581 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:20.965666 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:20.966442 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:20.967473 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:20.968806 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:20.969450 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:20.969575 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:20.973743 (+ 4168us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:57047: BlockingRecv error: recv got EOF from 127.10.205.66:57047 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 06:53:21 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:21 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:21.449545 20953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:21.441100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:59293)
0809 06:53:21.441654 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:21.441693 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:21.441910 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:21.442223 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:21.442226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:21.442631 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:21.442784 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:21.442792 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:21.443752 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:21.443755 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:21.444719 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:21.444731 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:21.445376 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:21.445380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:21.445528 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:21.446128 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:21.446146 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:21.449104 (+ 2958us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":330,"threads_started":1}
W20260809 06:53:21.449693 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:21.441197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:59293 (local address 127.10.205.126:39063)
0809 06:53:21.441382 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:21.441386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:21.441785 (+ 399us) server_negotiation.cc:407] Connection header received
0809 06:53:21.442017 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:21.442022 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:21.442088 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:21.442184 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:21.442907 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:21.443629 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:21.444841 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:21.445249 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:21.445339 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:21.449342 (+ 4003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:59293: BlockingRecv error: recv got EOF from 127.10.205.67:59293 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 06:53:21 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:21 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:21.521046 20954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:21.512002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:46693)
0809 06:53:21.512715 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:21.512734 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:21.512866 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:21.513179 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:21.513182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:21.513608 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:21.513801 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:21.513811 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:21.514958 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:21.514962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:21.515921 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:21.515934 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:21.516813 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:21.516818 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:21.516939 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:21.517538 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:21.517555 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:21.520671 (+ 3116us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":396,"threads_started":1}
W20260809 06:53:21.521193 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:21.512101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:46693 (local address 127.10.205.126:39063)
0809 06:53:21.512371 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:21.512379 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:21.512855 (+ 476us) server_negotiation.cc:407] Connection header received
0809 06:53:21.512961 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:21.512966 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:21.513034 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:21.513120 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:21.513974 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:21.514776 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:21.516081 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:21.516635 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:21.516742 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:21.520954 (+ 4212us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:46693: BlockingRecv error: recv got EOF from 127.10.205.65:46693 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 09 06:53:21 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:21 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:21.983596 20955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:21.974831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:33095)
0809 06:53:21.975480 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:21.975497 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:21.975661 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:21.976011 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:21.976016 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:21.976524 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:21.976692 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:21.976702 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:21.977770 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:21.977776 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:21.978723 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:21.978734 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:21.979519 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:21.979525 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:21.979704 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:21.980392 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:21.980410 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:21.983355 (+ 2945us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":366,"threads_started":1}
W20260809 06:53:21.983801 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:21.974987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:33095 (local address 127.10.205.126:39063)
0809 06:53:21.975191 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:21.975200 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:21.975586 (+ 386us) server_negotiation.cc:407] Connection header received
0809 06:53:21.975787 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:21.975793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:21.975865 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:21.975973 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:21.976847 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:21.977617 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:21.978882 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:21.979319 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:21.979459 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:21.983569 (+ 4110us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:33095: BlockingRecv error: recv got EOF from 127.10.205.66:33095 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 09 06:53:22 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:22 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:22.459470 20956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:22.450567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:33315)
0809 06:53:22.451140 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:22.451157 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:22.451289 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:22.451597 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:22.451601 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:22.452000 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:22.452173 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:22.452209 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:22.453263 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:22.453266 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:22.454207 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:22.454219 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:22.455038 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:22.455043 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:22.455158 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:22.455788 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:22.455805 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:22.459232 (+ 3427us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":306,"threads_started":1}
W20260809 06:53:22.459767 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:22.450673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:33315 (local address 127.10.205.126:39063)
0809 06:53:22.450946 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:22.450953 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:22.451249 (+ 296us) server_negotiation.cc:407] Connection header received
0809 06:53:22.451392 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:22.451395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:22.451460 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:22.451543 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:22.452373 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:22.453121 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:22.454338 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:22.454878 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:22.454974 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:22.459495 (+ 4521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:33315: BlockingRecv error: recv got EOF from 127.10.205.67:33315 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 09 06:53:22 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:22 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:22.530097 20957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:22.522051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:44723)
0809 06:53:22.522554 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:22.522572 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:22.522703 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:22.523014 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:22.523017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:22.523397 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:22.523589 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:22.523598 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:22.524639 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:22.524643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:22.525558 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:22.525570 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:22.526268 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:22.526272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:22.526393 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:22.527013 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:22.527032 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:22.529844 (+ 2812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":249,"threads_started":1}
W20260809 06:53:22.530270 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:22.522192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:44723 (local address 127.10.205.126:39063)
0809 06:53:22.522562 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:22.522566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:22.522658 (+ 92us) server_negotiation.cc:407] Connection header received
0809 06:53:22.522815 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:22.522819 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:22.522882 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:22.522963 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:22.523727 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:22.524507 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:22.525686 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:22.526124 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:22.526216 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:22.530050 (+ 3834us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:44723: BlockingRecv error: recv got EOF from 127.10.205.65:44723 (error 108)
Metrics: {"server-negotiator.queue_time_us":226}
Aug 09 06:53:22 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:22 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:22.993628 20958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:22.984760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:48095)
0809 06:53:22.985298 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:22.985317 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:22.985485 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:22.985837 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:22.985841 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:22.986279 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:22.986464 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:22.986474 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:22.987615 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:22.987621 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:22.988650 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:22.988662 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:22.989425 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:22.989431 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:22.989616 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:22.990232 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:22.990250 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:22.993229 (+ 2979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":294,"threads_started":1}
W20260809 06:53:22.993749 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:22.984891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:48095 (local address 127.10.205.126:39063)
0809 06:53:22.985103 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:22.985111 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:22.985419 (+ 308us) server_negotiation.cc:407] Connection header received
0809 06:53:22.985621 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:22.985633 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:22.985696 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:22.985809 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:22.986613 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:22.987466 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:22.988800 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:22.989275 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:22.989412 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:22.993518 (+ 4106us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:48095: BlockingRecv error: recv got EOF from 127.10.205.66:48095 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 06:53:23 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:23 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.67@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:23.471783 20959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:23.460399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.67:59355)
0809 06:53:23.460949 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:23.460965 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:23.461082 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:23.461393 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:23.461396 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:23.461765 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:23.462005 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:23.462016 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:23.463015 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:23.463018 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:23.463943 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:23.463954 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:23.464619 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:23.464623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:23.464741 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:23.468543 (+ 3802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:23.468562 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:23.471521 (+ 2959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":277,"threads_started":1}
W20260809 06:53:23.471946 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:23.460464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:59355 (local address 127.10.205.126:39063)
0809 06:53:23.460729 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:23.460735 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:23.461066 (+ 331us) server_negotiation.cc:407] Connection header received
0809 06:53:23.461200 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:23.461203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:23.461267 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:23.461345 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:23.462132 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:23.462891 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:23.464067 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:23.464494 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:23.464584 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:23.471730 (+ 7146us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.67:59355: BlockingRecv error: recv got EOF from 127.10.205.67:59355 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 09 06:53:23 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:23 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.65@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:23.539911 20960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:23.531363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.65:44331)
0809 06:53:23.531959 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:23.531976 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:23.532133 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:23.532514 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:23.532519 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:23.532962 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:23.533131 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:23.533140 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:23.534204 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:23.534212 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:23.535142 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:23.535154 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:23.535908 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:23.535914 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:23.536117 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:23.536826 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:23.536844 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:23.539636 (+ 2792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":309,"threads_started":1}
W20260809 06:53:23.540066 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:23.531452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:44331 (local address 127.10.205.126:39063)
0809 06:53:23.531746 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:23.531752 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:23.532065 (+ 313us) server_negotiation.cc:407] Connection header received
0809 06:53:23.532293 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:23.532300 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:23.532363 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:23.532504 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:23.533280 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:23.534053 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:23.535291 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:23.535743 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:23.535880 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:23.539852 (+ 3972us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.65:44331: BlockingRecv error: recv got EOF from 127.10.205.65:44331 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 09 06:53:23 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:53:23 dist-test-slave-0b58 krb5kdc[19838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.205.66@KRBTEST.COM for oryx/127.10.205.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:53:24.002895 20961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:23.994893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39063 (local address 127.10.205.66:48059)
0809 06:53:23.995480 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:23.995497 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:23.995609 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:23.995906 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:23.995909 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:23.996339 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:23.996512 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:23.996522 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:23.997532 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:23.997536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:23.998455 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:23.998466 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:23.999147 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:23.999151 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:23.999299 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:23.999921 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:23.999938 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:24.002643 (+ 2705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.205.126:39063: Server oryx/127.10.205.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":287,"threads_started":1}
W20260809 06:53:24.003108 20633 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:23.994964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:48059 (local address 127.10.205.126:39063)
0809 06:53:23.995128 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:23.995132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:23.995572 (+ 440us) server_negotiation.cc:407] Connection header received
0809 06:53:23.995707 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:23.995711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:23.995772 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:23.995855 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:23.996643 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:23.997380 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:23.998579 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:23.999029 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:23.999118 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:24.002871 (+ 3753us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.205.66:48059: BlockingRecv error: recv got EOF from 127.10.205.66:48059 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:53:24.299155 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 20474
I20260809 06:53:24.312165 20963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:24.300396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43740 (local address 127.10.205.65:34863)
0809 06:53:24.300990 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:24.300997 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:24.301025 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:53:24.301085 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:24.301092 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:24.301309 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:24.301473 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:24.302974 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:24.304007 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:24.305618 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:24.306200 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:24.306302 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:24.309121 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:24.309130 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:24.309144 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:24.309187 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:24.311647 (+ 2460us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.205.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 06:53:24.311924 (+ 277us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43740: Request ticket server kudu/127.10.205.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":293,"threads_started":1}
W20260809 06:53:24.312326 20963 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43740: Request ticket server kudu/127.10.205.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 06:53:24.312394 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 20474: Not authorized: Client connection negotiation failed: client connection to 127.10.205.65:34863: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.205.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 06:53:24.312630 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 20474
I20260809 06:53:24.332412 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 20635
I20260809 06:53:24.345515 20964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:24.333654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41714 (local address 127.10.205.66:38543)
0809 06:53:24.334351 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:24.334359 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:24.334390 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:53:24.334450 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:24.334456 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:24.334675 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:24.334842 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:24.336245 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:24.337512 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:24.338734 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:24.339312 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:24.339418 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:24.342009 (+ 2591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:24.342018 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:24.342033 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:24.342068 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:24.344849 (+ 2781us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.205.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 06:53:24.345176 (+ 327us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41714: Request ticket server kudu/127.10.205.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":367,"threads_started":1}
W20260809 06:53:24.345633 20964 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41714: Request ticket server kudu/127.10.205.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 06:53:24.345669 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 20635: Not authorized: Client connection negotiation failed: client connection to 127.10.205.66:38543: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.205.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 06:53:24.345868 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 20635
I20260809 06:53:24.368157 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 20776
I20260809 06:53:24.380439 20965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:24.369260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53912 (local address 127.10.205.67:32895)
0809 06:53:24.369910 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:24.369917 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:24.369945 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:53:24.370010 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:24.370016 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:24.370235 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:24.370403 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:24.371749 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:24.372859 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:24.374063 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:24.374632 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:24.374729 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:24.377370 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:24.377378 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:24.377393 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:24.377443 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:24.379851 (+ 2408us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.205.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 06:53:24.380114 (+ 263us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53912: Request ticket server kudu/127.10.205.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":320,"threads_started":1}
W20260809 06:53:24.380568 20965 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53912: Request ticket server kudu/127.10.205.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 06:53:24.380690 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 20776: Not authorized: Client connection negotiation failed: client connection to 127.10.205.67:32895: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.205.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 06:53:24.380880 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 20776
I20260809 06:53:24.399904 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 20399
I20260809 06:53:24.401363 20467 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:24.520658 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 20399
2026-08-09T06:53:24Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21517 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T06:53:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:53:24Z Disabled control of system clock
I20260809 06:53:24.616951 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:40237
--webserver_interface=127.10.205.126
--webserver_port=0
--builtin_ntp_servers=127.10.205.84:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:40237
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 06:53:24.959846 20970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:24.960184 20970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:24.960327 20970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:24.968039 20970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:53:24.968180 20970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:24.968226 20970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:24.968359 20970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:53:24.968489 20970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:53:24.979691 20970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:40237
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:40237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:24.981119 20970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:24.983003 20970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:24.995410 20975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:24.995437 20978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:24.995496 20976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:24.995970 20970 server_base.cc:1034] running on GCE node
I20260809 06:53:24.996894 20970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:24.998325 20970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:24.999571 20970 hybrid_clock.cc:648] HybridClock initialized: now 1786258404999545 us; error 60 us; skew 500 ppm
I20260809 06:53:24.999956 20970 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:53:25.002436 20970 webserver.cc:460] Webserver started at http://127.10.205.126:42893/ using document root <none> and password file <none>
I20260809 06:53:25.003216 20970 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:25.003360 20970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:25.003705 20970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:25.006812 20970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "69085302a7724b93aec62694d633f988"
format_stamp: "Formatted at 2026-08-09 06:53:24 on dist-test-slave-0b58"
server_key: "cd94a13840d5f85bd5b5c0d752ee665b"
server_key_iv: "34cbaf16f04339a84bf7f1a6ca7dbd2d"
server_key_version: "encryptionkey@0"
I20260809 06:53:25.007658 20970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "69085302a7724b93aec62694d633f988"
format_stamp: "Formatted at 2026-08-09 06:53:24 on dist-test-slave-0b58"
server_key: "cd94a13840d5f85bd5b5c0d752ee665b"
server_key_iv: "34cbaf16f04339a84bf7f1a6ca7dbd2d"
server_key_version: "encryptionkey@0"
I20260809 06:53:25.013017 20970 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260809 06:53:25.016641 20984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:25.018070 20970 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:53:25.018302 20970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "69085302a7724b93aec62694d633f988"
format_stamp: "Formatted at 2026-08-09 06:53:24 on dist-test-slave-0b58"
server_key: "cd94a13840d5f85bd5b5c0d752ee665b"
server_key_iv: "34cbaf16f04339a84bf7f1a6ca7dbd2d"
server_key_version: "encryptionkey@0"
I20260809 06:53:25.018548 20970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:25.037935 20970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:25.038915 20970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:25.039239 20970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:25.059396 20970 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:40237
I20260809 06:53:25.059422 21042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:40237 every 8 connection(s)
I20260809 06:53:25.060917 20970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:53:25.064775 21043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:53:25.065188 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 20970
I20260809 06:53:25.065428 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:53:25.066097 11061 external_mini_cluster.cc:1428] Setting key e7be8b126affd271ff9feafd78c44c71
I20260809 06:53:25.079142 21043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988: Bootstrap starting.
I20260809 06:53:25.080838 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:25.068247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36770 (local address 127.10.205.126:40237)
0809 06:53:25.069355 (+ 1108us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:25.069373 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:25.069416 (+ 43us) server_negotiation.cc:407] Connection header received
0809 06:53:25.071129 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:25.071154 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:25.071679 (+ 525us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:25.072077 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:25.072863 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:25.074129 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:25.076100 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:25.076894 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:25.077030 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:25.078363 (+ 1333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:25.078370 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:25.078385 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:25.078942 (+ 557us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:25.079021 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:25.079043 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:25.079135 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:25.079454 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 06:53:25.079808 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":351,"threads_started":1}
I20260809 06:53:25.082643 21043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988: Neither blocks nor log segments found. Creating new log.
I20260809 06:53:25.083745 21043 log.cc:824] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988: Log is configured to *not* fsync() on all Append() calls
I20260809 06:53:25.086627 21043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988: No bootstrap required, opened a new log
I20260809 06:53:25.093953 21043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69085302a7724b93aec62694d633f988" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40237 } }
I20260809 06:53:25.094362 21043 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:53:25.094491 21043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69085302a7724b93aec62694d633f988, State: Initialized, Role: FOLLOWER
I20260809 06:53:25.095148 21043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69085302a7724b93aec62694d633f988" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40237 } }
I20260809 06:53:25.095399 21043 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:53:25.095535 21043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:53:25.095712 21043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:53:25.098037 21043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69085302a7724b93aec62694d633f988" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40237 } }
I20260809 06:53:25.098573 21043 leader_election.cc:302] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69085302a7724b93aec62694d633f988; no voters:
I20260809 06:53:25.099174 21043 leader_election.cc:288] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:53:25.099360 21048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:53:25.100623 21048 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [term 1 LEADER]: Becoming Leader. State: Replica: 69085302a7724b93aec62694d633f988, State: Running, Role: LEADER
I20260809 06:53:25.101205 21048 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69085302a7724b93aec62694d633f988" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40237 } }
I20260809 06:53:25.101538 21043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:53:25.104277 21049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69085302a7724b93aec62694d633f988" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69085302a7724b93aec62694d633f988" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40237 } } }
I20260809 06:53:25.104684 21049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [sys.catalog]: This master's current role is: LEADER
I20260809 06:53:25.103948 21050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69085302a7724b93aec62694d633f988. Latest consensus state: current_term: 1 leader_uuid: "69085302a7724b93aec62694d633f988" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69085302a7724b93aec62694d633f988" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40237 } } }
I20260809 06:53:25.105413 21050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988 [sys.catalog]: This master's current role is: LEADER
I20260809 06:53:25.105686 21057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:53:25.113163 21057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:53:25.122572 21057 catalog_manager.cc:1347] Generated new cluster ID: b6470d500c9442a483b9ebe61ae1f4a8
I20260809 06:53:25.122713 21057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:53:25.157338 21057 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:53:25.159279 21057 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:53:25.172247 21057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69085302a7724b93aec62694d633f988: Generated new TSK 0
I20260809 06:53:25.173451 21057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:53:25.181541 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:40237
--builtin_ntp_servers=127.10.205.84:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 06:53:25.545074 21068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:25.545446 21068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:25.545612 21068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:25.553618 21068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:25.553766 21068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:25.553958 21068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:53:25.563478 21068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:40237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:25.564987 21068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:25.566859 21068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:25.581137 21074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:25.581396 21076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:25.581176 21073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:25.582476 21068 server_base.cc:1034] running on GCE node
I20260809 06:53:25.583148 21068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:25.584173 21068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:25.585440 21068 hybrid_clock.cc:648] HybridClock initialized: now 1786258405585385 us; error 46 us; skew 500 ppm
I20260809 06:53:25.585777 21068 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:53:25.588069 21068 webserver.cc:460] Webserver started at http://127.10.205.65:39145/ using document root <none> and password file <none>
I20260809 06:53:25.588874 21068 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:25.589017 21068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:25.589372 21068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:25.592308 21068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "75338ba14e29463b9e1510a54fb4b06d"
format_stamp: "Formatted at 2026-08-09 06:53:25 on dist-test-slave-0b58"
server_key: "ec88e95aa239ec25d92e341b361ab34f"
server_key_iv: "a13bca2a4ef7ba93cc7765c3846b61dc"
server_key_version: "encryptionkey@0"
I20260809 06:53:25.593179 21068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "75338ba14e29463b9e1510a54fb4b06d"
format_stamp: "Formatted at 2026-08-09 06:53:25 on dist-test-slave-0b58"
server_key: "ec88e95aa239ec25d92e341b361ab34f"
server_key_iv: "a13bca2a4ef7ba93cc7765c3846b61dc"
server_key_version: "encryptionkey@0"
I20260809 06:53:25.598441 21068 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:53:25.601966 21082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:25.603411 21068 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:53:25.603602 21068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "75338ba14e29463b9e1510a54fb4b06d"
format_stamp: "Formatted at 2026-08-09 06:53:25 on dist-test-slave-0b58"
server_key: "ec88e95aa239ec25d92e341b361ab34f"
server_key_iv: "a13bca2a4ef7ba93cc7765c3846b61dc"
server_key_version: "encryptionkey@0"
I20260809 06:53:25.603859 21068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:25.622845 21068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:25.623773 21068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:25.624107 21068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:25.625164 21068 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:25.626664 21068 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:25.626799 21068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:25.626930 21068 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:25.627019 21068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:25.661290 21068 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:45877
I20260809 06:53:25.661389 21199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:45877 every 8 connection(s)
I20260809 06:53:25.662694 21068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:53:25.671370 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 21068
I20260809 06:53:25.671600 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:53:25.672437 11061 external_mini_cluster.cc:1428] Setting key c6a2c3708813c60ff3041e311c309965
I20260809 06:53:25.675741 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:40237
--builtin_ntp_servers=127.10.205.84:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 06:53:25.677074 21202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:25.665607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:50513 (local address 127.10.205.126:40237)
0809 06:53:25.666159 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:25.666164 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:25.667507 (+ 1343us) server_negotiation.cc:407] Connection header received
0809 06:53:25.669369 (+ 1862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:25.669374 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:25.669446 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:25.669549 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:25.670600 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:25.671766 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:25.673833 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:25.674474 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:25.674589 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:25.676228 (+ 1639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:25.676233 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:25.676236 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:25.676298 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:25.676348 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:25.676361 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:25.676434 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:25.676723 (+ 289us) server_negotiation.cc:299] Negotiation successful
0809 06:53:25.676812 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":323,"threads_started":1}
I20260809 06:53:25.678686 21203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:25.666392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:40237 (local address 127.10.205.65:50513)
0809 06:53:25.667320 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:25.667366 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:25.669117 (+ 1751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:25.669781 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:25.669789 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:25.669873 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:25.670452 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:25.670470 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:25.671993 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:25.671997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:25.673675 (+ 1678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:25.673693 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:25.674730 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:25.674738 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:25.675045 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:25.675843 (+ 798us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:53:25.675847 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:25.675909 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:53:25.676030 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:53:25.676463 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:53:25.676477 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:53:25.676490 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 06:53:25.676711 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 06:53:25.677185 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":289,"threads_started":1}
I20260809 06:53:25.680231 21200 heartbeater.cc:347] Connected to a master server at 127.10.205.126:40237
I20260809 06:53:25.680564 21200 heartbeater.cc:464] Registering TS with master...
I20260809 06:53:25.681361 21200 heartbeater.cc:511] Master 127.10.205.126:40237 requested a full tablet report, sending...
I20260809 06:53:25.683409 21003 ts_manager.cc:194] Registered new tserver with Master: 75338ba14e29463b9e1510a54fb4b06d (127.10.205.65:45877)
I20260809 06:53:25.684962 21003 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.205.65:50513
W20260809 06:53:26.023742 21204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:26.024113 21204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:26.024312 21204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:26.031872 21204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:26.032029 21204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:26.032198 21204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:53:26.041594 21204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:40237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:26.043015 21204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:26.044987 21204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:26.058501 21212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:26.058476 21209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:26.059506 21204 server_base.cc:1034] running on GCE node
W20260809 06:53:26.060392 21210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:26.061115 21204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:26.062166 21204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:26.063393 21204 hybrid_clock.cc:648] HybridClock initialized: now 1786258406063336 us; error 54 us; skew 500 ppm
I20260809 06:53:26.063714 21204 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:53:26.066270 21204 webserver.cc:460] Webserver started at http://127.10.205.66:39663/ using document root <none> and password file <none>
I20260809 06:53:26.066977 21204 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:26.067095 21204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:26.067449 21204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:26.070385 21204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "a7b1008570704d25a6b9a2a014a818aa"
format_stamp: "Formatted at 2026-08-09 06:53:26 on dist-test-slave-0b58"
server_key: "caf1b8d9712cbf9303c72694a2ad5e0b"
server_key_iv: "11d304d1c90543ea38b76d5213a7e046"
server_key_version: "encryptionkey@0"
I20260809 06:53:26.071175 21204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "a7b1008570704d25a6b9a2a014a818aa"
format_stamp: "Formatted at 2026-08-09 06:53:26 on dist-test-slave-0b58"
server_key: "caf1b8d9712cbf9303c72694a2ad5e0b"
server_key_iv: "11d304d1c90543ea38b76d5213a7e046"
server_key_version: "encryptionkey@0"
I20260809 06:53:26.076241 21204 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 06:53:26.079815 21219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:26.081211 21204 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 06:53:26.081413 21204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "a7b1008570704d25a6b9a2a014a818aa"
format_stamp: "Formatted at 2026-08-09 06:53:26 on dist-test-slave-0b58"
server_key: "caf1b8d9712cbf9303c72694a2ad5e0b"
server_key_iv: "11d304d1c90543ea38b76d5213a7e046"
server_key_version: "encryptionkey@0"
I20260809 06:53:26.081650 21204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:26.106496 21204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:26.107499 21204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:26.107859 21204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:26.109071 21204 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:26.110611 21204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:26.110750 21204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:26.110898 21204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:26.110992 21204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:26.145220 21204 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:40711
I20260809 06:53:26.145318 21335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:40711 every 8 connection(s)
I20260809 06:53:26.146610 21204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:53:26.147346 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 21204
I20260809 06:53:26.147583 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:53:26.148167 11061 external_mini_cluster.cc:1428] Setting key e0db92f35b0695b929ed0cbe88877421
I20260809 06:53:26.151691 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:40237
--builtin_ntp_servers=127.10.205.84:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 06:53:26.163496 21202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:26.149481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:58661 (local address 127.10.205.126:40237)
0809 06:53:26.149657 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:26.149661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:26.151541 (+ 1880us) server_negotiation.cc:407] Connection header received
0809 06:53:26.154640 (+ 3099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:26.154652 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:26.154746 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:26.154862 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:26.156354 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.157421 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.160008 (+ 2587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.160658 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.160792 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:26.162565 (+ 1773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:26.162573 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:26.162580 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:26.162607 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:26.162648 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:26.162665 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:26.162754 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:26.163009 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 06:53:26.163119 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:53:26.165014 21338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:26.150193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:40237 (local address 127.10.205.66:58661)
0809 06:53:26.151369 (+ 1176us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:26.151421 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:26.154290 (+ 2869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:26.155124 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:26.155137 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:26.155262 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:26.156078 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:26.156107 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.157619 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.157627 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:26.159842 (+ 2215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:26.159861 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.160903 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.160919 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:26.161281 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:26.162147 (+ 866us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:53:26.162153 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:26.162212 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:53:26.162343 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:53:26.162769 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:53:26.162781 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:53:26.162792 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 06:53:26.162986 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 06:53:26.163446 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":338,"threads_started":1}
I20260809 06:53:26.166656 21336 heartbeater.cc:347] Connected to a master server at 127.10.205.126:40237
I20260809 06:53:26.166985 21336 heartbeater.cc:464] Registering TS with master...
I20260809 06:53:26.167766 21336 heartbeater.cc:511] Master 127.10.205.126:40237 requested a full tablet report, sending...
I20260809 06:53:26.169430 21003 ts_manager.cc:194] Registered new tserver with Master: a7b1008570704d25a6b9a2a014a818aa (127.10.205.66:40711)
I20260809 06:53:26.170758 21003 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.205.66:58661
W20260809 06:53:26.498417 21339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:26.498729 21339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:26.498819 21339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:26.506362 21339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:26.506474 21339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:26.506577 21339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:53:26.515879 21339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:40237
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:26.517266 21339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:26.519053 21339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:26.532582 21347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:26.532684 21345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:26.532630 21344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:26.537743 21339 server_base.cc:1034] running on GCE node
I20260809 06:53:26.538443 21339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:26.539476 21339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:26.540705 21339 hybrid_clock.cc:648] HybridClock initialized: now 1786258406540627 us; error 67 us; skew 500 ppm
I20260809 06:53:26.541055 21339 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:53:26.543567 21339 webserver.cc:460] Webserver started at http://127.10.205.67:45047/ using document root <none> and password file <none>
I20260809 06:53:26.544365 21339 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:26.544497 21339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:26.544862 21339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:26.547799 21339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "c656ebe1d1974f08b268e7aeaf6b119c"
format_stamp: "Formatted at 2026-08-09 06:53:26 on dist-test-slave-0b58"
server_key: "dbc439702542ef18e624938fa3654e11"
server_key_iv: "8faad6bd2fd8d4cb045e9ef4f28205d4"
server_key_version: "encryptionkey@0"
I20260809 06:53:26.548702 21339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "c656ebe1d1974f08b268e7aeaf6b119c"
format_stamp: "Formatted at 2026-08-09 06:53:26 on dist-test-slave-0b58"
server_key: "dbc439702542ef18e624938fa3654e11"
server_key_iv: "8faad6bd2fd8d4cb045e9ef4f28205d4"
server_key_version: "encryptionkey@0"
I20260809 06:53:26.554206 21339 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 06:53:26.557610 21353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:26.558957 21339 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:53:26.559147 21339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "c656ebe1d1974f08b268e7aeaf6b119c"
format_stamp: "Formatted at 2026-08-09 06:53:26 on dist-test-slave-0b58"
server_key: "dbc439702542ef18e624938fa3654e11"
server_key_iv: "8faad6bd2fd8d4cb045e9ef4f28205d4"
server_key_version: "encryptionkey@0"
I20260809 06:53:26.559391 21339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:26.573706 21339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:26.574693 21339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:26.575037 21339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:26.576061 21339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:26.577636 21339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:26.577728 21339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:26.577821 21339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:26.577879 21339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:26.613049 21339 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:37233
I20260809 06:53:26.613106 21470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:37233 every 8 connection(s)
I20260809 06:53:26.614432 21339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:53:26.615036 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 21339
I20260809 06:53:26.615247 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:53:26.615878 11061 external_mini_cluster.cc:1428] Setting key f1ee135a0f68c532cc0eb9a5894f643b
I20260809 06:53:26.627068 21202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:26.617241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:60239 (local address 127.10.205.126:40237)
0809 06:53:26.617455 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:26.617461 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:26.619036 (+ 1575us) server_negotiation.cc:407] Connection header received
0809 06:53:26.620926 (+ 1890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:26.620930 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:26.621013 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:26.621100 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:26.622103 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.622924 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.624672 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.625069 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.625159 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:26.626399 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:26.626403 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:26.626406 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:26.626423 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:26.626456 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:26.626467 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:26.626537 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:26.626742 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 06:53:26.626822 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 06:53:26.628062 21473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:26.617904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:40237 (local address 127.10.205.67:60239)
0809 06:53:26.618870 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:26.618919 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:26.620685 (+ 1766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:26.621317 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:26.621325 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:26.621408 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:26.621963 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:26.621979 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.623057 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.623061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:26.624550 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:26.624562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.625247 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.625251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:26.625452 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:26.626080 (+ 628us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:53:26.626083 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:26.626130 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:53:26.626225 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:53:26.626552 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:53:26.626561 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:53:26.626567 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:53:26.626713 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 06:53:26.627003 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":340,"threads_started":1}
I20260809 06:53:26.629438 21471 heartbeater.cc:347] Connected to a master server at 127.10.205.126:40237
I20260809 06:53:26.629769 21471 heartbeater.cc:464] Registering TS with master...
I20260809 06:53:26.630791 21471 heartbeater.cc:511] Master 127.10.205.126:40237 requested a full tablet report, sending...
I20260809 06:53:26.632387 21003 ts_manager.cc:194] Registered new tserver with Master: c656ebe1d1974f08b268e7aeaf6b119c (127.10.205.67:37233)
I20260809 06:53:26.633183 21003 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.205.67:60239
I20260809 06:53:26.644410 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 06:53:26.650694 21202 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:26.649146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36778 (local address 127.10.205.126:40237)
0809 06:53:26.649419 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:26.649428 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:26.649754 (+ 326us) server_negotiation.cc:407] Connection header received
0809 06:53:26.649885 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:26.649889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:26.649966 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:26.650045 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:26.650489 (+ 444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36778: BlockingRecv error: recv got EOF from 127.0.0.1:36778 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 06:53:26.651388 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 21068
I20260809 06:53:26.659075 21480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:26.652371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45588 (local address 127.10.205.65:45877)
0809 06:53:26.652969 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:26.652977 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:26.653015 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:53:26.653073 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:26.653097 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:26.653323 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:26.653444 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:26.653823 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.654851 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.656042 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.656652 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.656746 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:26.657750 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:26.657758 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:26.657770 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:26.658341 (+ 571us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:26.658386 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:26.658405 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:26.658494 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:26.658652 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 06:53:26.658775 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":309,"threads_started":1}
I20260809 06:53:26.660327 21195 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:26.742125 21200 heartbeater.cc:503] Master 127.10.205.126:40237 was elected leader, sending a full tablet report...
I20260809 06:53:26.743281 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 21068
I20260809 06:53:26.763278 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 21204
I20260809 06:53:26.771366 21482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:26.764395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45868 (local address 127.10.205.66:40711)
0809 06:53:26.765031 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:26.765039 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:26.765070 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:53:26.765133 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:26.765146 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:26.765370 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:26.765502 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:26.765878 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.766912 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.768142 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.768905 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.769005 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:26.769970 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:26.769977 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:26.769991 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:26.770617 (+ 626us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:26.770665 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:26.770685 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:26.770778 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:26.770922 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 06:53:26.771042 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":354,"threads_started":1}
I20260809 06:53:26.772759 21331 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:26.856750 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 21204
I20260809 06:53:26.876222 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 21339
I20260809 06:53:26.885025 21484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:26.877349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56784 (local address 127.10.205.67:37233)
0809 06:53:26.878038 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:26.878053 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:26.878083 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:53:26.878148 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:26.878154 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:26.878375 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:26.878559 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:26.879068 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.880081 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.881559 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:26.882136 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:26.882287 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:26.883431 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:26.883439 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:26.883454 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:26.884087 (+ 633us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:26.884135 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:26.884160 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:26.884342 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:26.884495 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 06:53:26.884653 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":374,"threads_started":1}
I20260809 06:53:26.886535 21465 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:26.968729 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 21339
I20260809 06:53:26.988186 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 20970
I20260809 06:53:26.989568 21037 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:27.093873 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 20970
2026-08-09T06:53:27Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2563 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T06:53:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:53:27Z Disabled control of system clock
I20260809 06:53:27.178171 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:33955
--webserver_interface=127.10.205.126
--webserver_port=0
--builtin_ntp_servers=127.10.205.84:34105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:33955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 06:53:27.521191 21490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:27.521505 21490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:27.521682 21490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:27.529306 21490 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:53:27.529475 21490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:27.529577 21490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:27.529686 21490 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:53:27.529780 21490 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:53:27.539551 21490 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:33955
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:33955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:27.541007 21490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:27.542956 21490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:27.555415 21496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:27.555301 21499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:27.555297 21497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:27.556582 21490 server_base.cc:1034] running on GCE node
I20260809 06:53:27.557408 21490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:27.558873 21490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:27.560086 21490 hybrid_clock.cc:648] HybridClock initialized: now 1786258407560022 us; error 53 us; skew 500 ppm
I20260809 06:53:27.560536 21490 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:53:27.562937 21490 webserver.cc:460] Webserver started at http://127.10.205.126:33649/ using document root <none> and password file <none>
I20260809 06:53:27.563673 21490 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:27.563802 21490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:27.564158 21490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:27.569782 21490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "2cdce620b24f459da602b99f17d57b87"
format_stamp: "Formatted at 2026-08-09 06:53:27 on dist-test-slave-0b58"
server_key: "bfbfe87ffadd46f4ad344f5a95fec162"
server_key_iv: "6c467f46533b9ed98b1c69ac286e4363"
server_key_version: "encryptionkey@0"
I20260809 06:53:27.570662 21490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "2cdce620b24f459da602b99f17d57b87"
format_stamp: "Formatted at 2026-08-09 06:53:27 on dist-test-slave-0b58"
server_key: "bfbfe87ffadd46f4ad344f5a95fec162"
server_key_iv: "6c467f46533b9ed98b1c69ac286e4363"
server_key_version: "encryptionkey@0"
I20260809 06:53:27.576007 21490 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260809 06:53:27.579631 21505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:27.581105 21490 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:53:27.581302 21490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "2cdce620b24f459da602b99f17d57b87"
format_stamp: "Formatted at 2026-08-09 06:53:27 on dist-test-slave-0b58"
server_key: "bfbfe87ffadd46f4ad344f5a95fec162"
server_key_iv: "6c467f46533b9ed98b1c69ac286e4363"
server_key_version: "encryptionkey@0"
I20260809 06:53:27.581537 21490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:27.587625 21490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:27.588541 21490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:27.588860 21490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:27.607898 21490 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:33955
I20260809 06:53:27.608006 21561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:33955 every 8 connection(s)
I20260809 06:53:27.609440 21490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:53:27.613286 21562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:53:27.618532 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 21490
I20260809 06:53:27.618780 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:53:27.619468 11061 external_mini_cluster.cc:1428] Setting key 9595c255d0f76cde871e6570bfd4eb48
I20260809 06:53:27.625604 21562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87: Bootstrap starting.
I20260809 06:53:27.629666 21566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:27.621691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33832 (local address 127.10.205.126:33955)
0809 06:53:27.622980 (+ 1289us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:27.622996 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:27.623054 (+ 58us) server_negotiation.cc:407] Connection header received
0809 06:53:27.625469 (+ 2415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:27.625501 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:27.626039 (+ 538us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:27.626498 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:27.627607 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:27.627617 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:27.627634 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:27.627653 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:27.627732 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:27.627758 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:27.627994 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:27.628142 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 06:53:27.628434 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":415,"threads_started":1}
I20260809 06:53:27.629822 21562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87: Neither blocks nor log segments found. Creating new log.
I20260809 06:53:27.630966 21562 log.cc:824] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87: Log is configured to *not* fsync() on all Append() calls
I20260809 06:53:27.633934 21562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87: No bootstrap required, opened a new log
I20260809 06:53:27.641297 21562 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cdce620b24f459da602b99f17d57b87" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33955 } }
I20260809 06:53:27.641697 21562 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:53:27.641795 21562 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cdce620b24f459da602b99f17d57b87, State: Initialized, Role: FOLLOWER
I20260809 06:53:27.642397 21562 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cdce620b24f459da602b99f17d57b87" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33955 } }
I20260809 06:53:27.642639 21562 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:53:27.642777 21562 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:53:27.642951 21562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:53:27.645264 21562 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cdce620b24f459da602b99f17d57b87" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33955 } }
I20260809 06:53:27.645792 21562 leader_election.cc:302] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2cdce620b24f459da602b99f17d57b87; no voters:
I20260809 06:53:27.646456 21562 leader_election.cc:288] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:53:27.646649 21569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:53:27.647397 21569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [term 1 LEADER]: Becoming Leader. State: Replica: 2cdce620b24f459da602b99f17d57b87, State: Running, Role: LEADER
I20260809 06:53:27.647976 21569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cdce620b24f459da602b99f17d57b87" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33955 } }
I20260809 06:53:27.648702 21562 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:53:27.650770 21570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2cdce620b24f459da602b99f17d57b87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cdce620b24f459da602b99f17d57b87" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33955 } } }
I20260809 06:53:27.651280 21570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [sys.catalog]: This master's current role is: LEADER
I20260809 06:53:27.651167 21571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2cdce620b24f459da602b99f17d57b87. Latest consensus state: current_term: 1 leader_uuid: "2cdce620b24f459da602b99f17d57b87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cdce620b24f459da602b99f17d57b87" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33955 } } }
I20260809 06:53:27.651551 21571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87 [sys.catalog]: This master's current role is: LEADER
I20260809 06:53:27.653862 21574 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:53:27.659772 21574 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:53:27.668864 21574 catalog_manager.cc:1347] Generated new cluster ID: 50cfa33c439e4c53b2a793112d968c04
I20260809 06:53:27.668990 21574 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:53:27.696166 21574 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:53:27.696640 21574 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:53:27.707329 21574 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2cdce620b24f459da602b99f17d57b87: Generated new TSK 0
I20260809 06:53:27.708213 21574 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:53:27.713083 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:33955
--builtin_ntp_servers=127.10.205.84:34105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 06:53:28.089118 21589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:28.089430 21589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:28.089525 21589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:28.097060 21589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:28.097196 21589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:28.097378 21589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:53:28.106737 21589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:33955
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:28.108168 21589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:28.110033 21589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:28.123523 21595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:28.123497 21596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:28.123492 21598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:28.124349 21589 server_base.cc:1034] running on GCE node
I20260809 06:53:28.125001 21589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:28.126008 21589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:28.127252 21589 hybrid_clock.cc:648] HybridClock initialized: now 1786258408127191 us; error 59 us; skew 500 ppm
I20260809 06:53:28.127600 21589 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:53:28.129993 21589 webserver.cc:460] Webserver started at http://127.10.205.65:41135/ using document root <none> and password file <none>
I20260809 06:53:28.130707 21589 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:28.130848 21589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:28.131198 21589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:28.134343 21589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "ecef96755f5f4728976a644914c2f5c0"
format_stamp: "Formatted at 2026-08-09 06:53:28 on dist-test-slave-0b58"
server_key: "2300677a02ff8d29c15e68a6ab0b279b"
server_key_iv: "92cd19b71838876294ae2d4ba778b12b"
server_key_version: "encryptionkey@0"
I20260809 06:53:28.135190 21589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "ecef96755f5f4728976a644914c2f5c0"
format_stamp: "Formatted at 2026-08-09 06:53:28 on dist-test-slave-0b58"
server_key: "2300677a02ff8d29c15e68a6ab0b279b"
server_key_iv: "92cd19b71838876294ae2d4ba778b12b"
server_key_version: "encryptionkey@0"
I20260809 06:53:28.140461 21589 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260809 06:53:28.144023 21604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:28.145402 21589 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:53:28.145586 21589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "ecef96755f5f4728976a644914c2f5c0"
format_stamp: "Formatted at 2026-08-09 06:53:28 on dist-test-slave-0b58"
server_key: "2300677a02ff8d29c15e68a6ab0b279b"
server_key_iv: "92cd19b71838876294ae2d4ba778b12b"
server_key_version: "encryptionkey@0"
I20260809 06:53:28.145825 21589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:28.151747 21589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:28.152648 21589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:28.152915 21589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:28.153858 21589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:28.155359 21589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:28.155484 21589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:28.155627 21589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:28.155718 21589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:28.190366 21589 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:42775
I20260809 06:53:28.190428 21724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:42775 every 8 connection(s)
I20260809 06:53:28.191778 21589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:53:28.199520 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 21589
I20260809 06:53:28.199759 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:53:28.200464 21727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:28.194468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:58941 (local address 127.10.205.126:33955)
0809 06:53:28.194905 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:28.194910 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:28.196108 (+ 1198us) server_negotiation.cc:407] Connection header received
0809 06:53:28.197871 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:28.197877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:28.197952 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:28.198077 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:28.199494 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:28.199501 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:28.199509 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:28.199529 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:28.199582 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:28.199599 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:28.199752 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:28.200043 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 06:53:28.200119 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":219,"threads_started":1}
I20260809 06:53:28.200665 11061 external_mini_cluster.cc:1428] Setting key 092a4d5028d5a703eb74428c81210db1
I20260809 06:53:28.201349 21728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:28.195068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:33955 (local address 127.10.205.65:58941)
0809 06:53:28.195940 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:28.195975 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:28.197572 (+ 1597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:28.198309 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:28.198316 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:28.198403 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:28.199153 (+ 750us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:53:28.199155 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:28.199210 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:53:28.199295 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:53:28.199788 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:53:28.199797 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:53:28.199803 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:53:28.200070 (+ 267us) client_negotiation.cc:240] Negotiation successful
0809 06:53:28.200303 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":266,"threads_started":1}
I20260809 06:53:28.202869 21725 heartbeater.cc:347] Connected to a master server at 127.10.205.126:33955
I20260809 06:53:28.203158 21725 heartbeater.cc:464] Registering TS with master...
I20260809 06:53:28.203791 21725 heartbeater.cc:511] Master 127.10.205.126:33955 requested a full tablet report, sending...
I20260809 06:53:28.203786 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:33955
--builtin_ntp_servers=127.10.205.84:34105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 06:53:28.206023 21522 ts_manager.cc:194] Registered new tserver with Master: ecef96755f5f4728976a644914c2f5c0 (127.10.205.65:42775)
W20260809 06:53:28.550654 21729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:28.550995 21729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:28.551193 21729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:28.558763 21729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:28.558883 21729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:28.559087 21729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:53:28.568427 21729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:33955
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:28.569816 21729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:28.571857 21729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:28.585942 21735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:28.585980 21737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:28.586206 21734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:28.587131 21729 server_base.cc:1034] running on GCE node
I20260809 06:53:28.587831 21729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:28.588909 21729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:28.590142 21729 hybrid_clock.cc:648] HybridClock initialized: now 1786258408590088 us; error 47 us; skew 500 ppm
I20260809 06:53:28.590523 21729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:53:28.597857 21729 webserver.cc:460] Webserver started at http://127.10.205.66:43291/ using document root <none> and password file <none>
I20260809 06:53:28.598667 21729 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:28.598824 21729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:28.599188 21729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:28.602288 21729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "892a9ecf69b84ddf9514eff58af5b5ff"
format_stamp: "Formatted at 2026-08-09 06:53:28 on dist-test-slave-0b58"
server_key: "f0fa423ebecb400158707f361e2c7874"
server_key_iv: "184452a43cf1db16341f5e18718bb05c"
server_key_version: "encryptionkey@0"
I20260809 06:53:28.603149 21729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "892a9ecf69b84ddf9514eff58af5b5ff"
format_stamp: "Formatted at 2026-08-09 06:53:28 on dist-test-slave-0b58"
server_key: "f0fa423ebecb400158707f361e2c7874"
server_key_iv: "184452a43cf1db16341f5e18718bb05c"
server_key_version: "encryptionkey@0"
I20260809 06:53:28.608834 21729 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 06:53:28.612541 21743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:28.613945 21729 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:53:28.614130 21729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "892a9ecf69b84ddf9514eff58af5b5ff"
format_stamp: "Formatted at 2026-08-09 06:53:28 on dist-test-slave-0b58"
server_key: "f0fa423ebecb400158707f361e2c7874"
server_key_iv: "184452a43cf1db16341f5e18718bb05c"
server_key_version: "encryptionkey@0"
I20260809 06:53:28.614377 21729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:28.620565 21729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:28.621424 21729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:28.621718 21729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:28.622689 21729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:28.624140 21729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:28.624305 21729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:28.624449 21729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:28.624539 21729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:28.659206 21729 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:37161
I20260809 06:53:28.659253 21865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:37161 every 8 connection(s)
I20260809 06:53:28.660729 21729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:53:28.665774 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 21729
I20260809 06:53:28.665969 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:53:28.666455 11061 external_mini_cluster.cc:1428] Setting key dad0681494e16a2b725a551c3406525e
I20260809 06:53:28.669386 21727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:28.663346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:45775 (local address 127.10.205.126:33955)
0809 06:53:28.663524 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:28.663529 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:28.664964 (+ 1435us) server_negotiation.cc:407] Connection header received
0809 06:53:28.666827 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:28.666834 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:28.666907 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:28.667034 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:28.668587 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:28.668592 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:28.668595 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:28.668611 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:28.668645 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:28.668656 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:28.668812 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:28.669013 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 06:53:28.669079 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:53:28.669863 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:33955
--builtin_ntp_servers=127.10.205.84:34105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 06:53:28.670316 21868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:28.663834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:33955 (local address 127.10.205.66:45775)
0809 06:53:28.664784 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:28.664839 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:28.666497 (+ 1658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:28.667313 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:28.667326 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:28.667434 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:28.668179 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:53:28.668182 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:28.668236 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:53:28.668385 (+ 149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:53:28.668802 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:53:28.668811 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:53:28.668817 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:53:28.669041 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 06:53:28.669243 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":272,"threads_started":1}
I20260809 06:53:28.673350 21866 heartbeater.cc:347] Connected to a master server at 127.10.205.126:33955
I20260809 06:53:28.673663 21866 heartbeater.cc:464] Registering TS with master...
I20260809 06:53:28.674248 21866 heartbeater.cc:511] Master 127.10.205.126:33955 requested a full tablet report, sending...
I20260809 06:53:28.675664 21522 ts_manager.cc:194] Registered new tserver with Master: 892a9ecf69b84ddf9514eff58af5b5ff (127.10.205.66:37161)
W20260809 06:53:29.013072 21869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:29.013439 21869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:29.013610 21869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:29.021014 21869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:29.021166 21869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:29.021373 21869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:53:29.030648 21869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:33955
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:29.032040 21869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:29.033982 21869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:29.047487 21875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:29.047415 21876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:29.047389 21878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:29.048444 21869 server_base.cc:1034] running on GCE node
I20260809 06:53:29.049186 21869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:29.050316 21869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:29.051558 21869 hybrid_clock.cc:648] HybridClock initialized: now 1786258409051516 us; error 54 us; skew 500 ppm
I20260809 06:53:29.051940 21869 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:53:29.054445 21869 webserver.cc:460] Webserver started at http://127.10.205.67:45453/ using document root <none> and password file <none>
I20260809 06:53:29.055202 21869 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:29.055342 21869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:29.055671 21869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:29.058914 21869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "6ecd9c7491174cd78e7fc68117fabda8"
format_stamp: "Formatted at 2026-08-09 06:53:29 on dist-test-slave-0b58"
server_key: "668ef70222ba5466e13916db5202c964"
server_key_iv: "51ba89a9a9153a0ced65d4078e9ee1b7"
server_key_version: "encryptionkey@0"
I20260809 06:53:29.059765 21869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "6ecd9c7491174cd78e7fc68117fabda8"
format_stamp: "Formatted at 2026-08-09 06:53:29 on dist-test-slave-0b58"
server_key: "668ef70222ba5466e13916db5202c964"
server_key_iv: "51ba89a9a9153a0ced65d4078e9ee1b7"
server_key_version: "encryptionkey@0"
I20260809 06:53:29.065299 21869 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260809 06:53:29.068861 21884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:29.070227 21869 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:53:29.070417 21869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "6ecd9c7491174cd78e7fc68117fabda8"
format_stamp: "Formatted at 2026-08-09 06:53:29 on dist-test-slave-0b58"
server_key: "668ef70222ba5466e13916db5202c964"
server_key_iv: "51ba89a9a9153a0ced65d4078e9ee1b7"
server_key_version: "encryptionkey@0"
I20260809 06:53:29.070654 21869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:29.076488 21869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:29.077322 21869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:29.077602 21869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:29.078596 21869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:29.080024 21869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:29.080166 21869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:29.080361 21869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:29.080459 21869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:29.114548 21869 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:44485
I20260809 06:53:29.114603 22002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:44485 every 8 connection(s)
I20260809 06:53:29.115972 21869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:53:29.119690 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 21869
I20260809 06:53:29.119903 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:53:29.120431 11061 external_mini_cluster.cc:1428] Setting key 4ca4dd2808907e4ccb133cf17828e34e
I20260809 06:53:29.124986 21727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:29.118737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:51059 (local address 127.10.205.126:33955)
0809 06:53:29.119001 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:29.119007 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:29.120752 (+ 1745us) server_negotiation.cc:407] Connection header received
0809 06:53:29.122778 (+ 2026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:29.122783 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:29.122860 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:29.122971 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:29.124415 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:29.124420 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:29.124423 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:29.124439 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:29.124473 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:29.124484 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:29.124584 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:29.124735 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 06:53:29.124782 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 06:53:29.125959 22006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:29.119423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:33955 (local address 127.10.205.67:51059)
0809 06:53:29.120548 (+ 1125us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:29.120595 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:29.122518 (+ 1923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:29.123183 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:29.123192 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:29.123284 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:29.124089 (+ 805us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:53:29.124092 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:29.124133 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:53:29.124222 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:53:29.124572 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:53:29.124580 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:53:29.124585 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 06:53:29.124810 (+ 225us) client_negotiation.cc:240] Negotiation successful
0809 06:53:29.125010 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":355,"threads_started":1}
I20260809 06:53:29.127352 22004 heartbeater.cc:347] Connected to a master server at 127.10.205.126:33955
I20260809 06:53:29.127662 22004 heartbeater.cc:464] Registering TS with master...
I20260809 06:53:29.128309 22004 heartbeater.cc:511] Master 127.10.205.126:33955 requested a full tablet report, sending...
I20260809 06:53:29.129745 21522 ts_manager.cc:194] Registered new tserver with Master: 6ecd9c7491174cd78e7fc68117fabda8 (127.10.205.67:44485)
I20260809 06:53:29.136178 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 06:53:29.142351 21727 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:53:29.140813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33846 (local address 127.10.205.126:33955)
0809 06:53:29.140978 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:29.140983 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:29.141538 (+ 555us) server_negotiation.cc:407] Connection header received
0809 06:53:29.141688 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:29.141692 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:29.141746 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:29.141832 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:29.142143 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33846: BlockingRecv error: recv got EOF from 127.0.0.1:33846 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:53:29.142989 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 21589
I20260809 06:53:29.146508 22014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:29.143982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50582 (local address 127.10.205.65:42775)
0809 06:53:29.144592 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:29.144598 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:29.144624 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:53:29.144680 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:29.144686 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:29.144892 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:29.145015 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:29.145891 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:29.145898 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:29.145909 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:29.145928 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:29.145974 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:29.145989 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:29.146093 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:29.146187 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 06:53:29.146265 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":329,"threads_started":1}
I20260809 06:53:29.147682 21720 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:29.228880 21725 heartbeater.cc:503] Master 127.10.205.126:33955 was elected leader, sending a full tablet report...
I20260809 06:53:29.230532 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 21589
W20260809 06:53:29.249151 21508 connection.cc:535] server connection from 127.10.205.65:58941 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 06:53:29.249500 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 21729
I20260809 06:53:29.253297 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:29.250586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52700 (local address 127.10.205.66:37161)
0809 06:53:29.251173 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:29.251182 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:29.251210 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:53:29.251274 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:29.251280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:29.251498 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:29.251626 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:29.252589 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:29.252595 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:29.252607 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:29.252644 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:29.252688 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:29.252704 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:29.252838 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:29.252893 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 06:53:29.253002 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":325,"threads_started":1}
I20260809 06:53:29.254611 21861 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:29.337059 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 21729
I20260809 06:53:29.355664 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 21869
I20260809 06:53:29.359864 22018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:29.356850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39556 (local address 127.10.205.67:44485)
0809 06:53:29.357508 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:29.357515 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:29.357547 (+ 32us) server_negotiation.cc:407] Connection header received
0809 06:53:29.357620 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:29.357627 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:29.357851 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:29.357978 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:29.358975 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:29.358982 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:29.359004 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:53:29.359023 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:29.359111 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:53:29.359131 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:29.359313 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:29.359380 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 06:53:29.359483 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":340,"threads_started":1}
I20260809 06:53:29.361215 21998 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:29.443913 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 21869
I20260809 06:53:29.463449 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 21490
I20260809 06:53:29.464814 21556 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:29.568836 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 21490
2026-08-09T06:53:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2477 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:53:29 dist-test-slave-0b58 krb5kdc[22023](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:53:29 dist-test-slave-0b58 krb5kdc[22023](info): set up 2 sockets
Aug 09 06:53:29 dist-test-slave-0b58 krb5kdc[22023](info): commencing operation
krb5kdc: starting...
W20260809 06:53:30.744395 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.003s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:53:30 dist-test-slave-0b58 krb5kdc[22023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:53:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:53:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:53:31.040290 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:41541
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:41541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:53:31.382797 22036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:31.383109 22036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:31.383203 22036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:31.390357 22036 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:53:31.390468 22036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:31.390514 22036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:31.390563 22036 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:53:31.390599 22036 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:53:31.400233 22036 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:41541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:41541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:31.401580 22036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:31.402858 22036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:31.415189 22041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:31.415210 22042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:31.415266 22044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:31.415791 22036 server_base.cc:1034] running on GCE node
I20260809 06:53:31.416806 22036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:31.418146 22036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:31.419356 22036 hybrid_clock.cc:648] HybridClock initialized: now 1786258411419304 us; error 51 us; skew 500 ppm
I20260809 06:53:31.419732 22036 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:53:31 dist-test-slave-0b58 krb5kdc[22023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258411, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:53:31.422999 22036 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:53:31.424566 22036 webserver.cc:460] Webserver started at http://127.10.205.126:38519/ using document root <none> and password file <none>
I20260809 06:53:31.425247 22036 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:31.425386 22036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:31.425733 22036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:31.428951 22036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "acbb09ca3efe49cbaa30f1969999793e"
format_stamp: "Formatted at 2026-08-09 06:53:31 on dist-test-slave-0b58"
server_key: "19d7b626dab34c435d96f9ac9e835004"
server_key_iv: "4bc33d0ce10a8e0cb3bbfa5c7588de15"
server_key_version: "encryptionkey@0"
I20260809 06:53:31.429801 22036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "acbb09ca3efe49cbaa30f1969999793e"
format_stamp: "Formatted at 2026-08-09 06:53:31 on dist-test-slave-0b58"
server_key: "19d7b626dab34c435d96f9ac9e835004"
server_key_iv: "4bc33d0ce10a8e0cb3bbfa5c7588de15"
server_key_version: "encryptionkey@0"
I20260809 06:53:31.435264 22036 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.006s
I20260809 06:53:31.438851 22051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:31.440424 22036 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:53:31.440606 22036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "acbb09ca3efe49cbaa30f1969999793e"
format_stamp: "Formatted at 2026-08-09 06:53:31 on dist-test-slave-0b58"
server_key: "19d7b626dab34c435d96f9ac9e835004"
server_key_iv: "4bc33d0ce10a8e0cb3bbfa5c7588de15"
server_key_version: "encryptionkey@0"
I20260809 06:53:31.440819 22036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:31.475219 22036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:31.479449 22036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:31.479794 22036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:31.499032 22036 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:41541
I20260809 06:53:31.499075 22104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:41541 every 8 connection(s)
I20260809 06:53:31.500547 22036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:53:31.504242 22105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:53:31.508014 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 22036
I20260809 06:53:31.508234 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:53:31.508925 11061 external_mini_cluster.cc:1428] Setting key 33fd9c0cf099666977bcd386b4a97a2e
I20260809 06:53:31.517884 22105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e: Bootstrap starting.
I20260809 06:53:31.521879 22105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e: Neither blocks nor log segments found. Creating new log.
I20260809 06:53:31.523309 22105 log.cc:824] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:53:31 dist-test-slave-0b58 krb5kdc[22023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:53:31.526592 22105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e: No bootstrap required, opened a new log
I20260809 06:53:31.533367 22108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:31.511006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58970 (local address 127.10.205.126:41541)
0809 06:53:31.511845 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:31.511857 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:31.511897 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:53:31.513546 (+ 1649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:31.513571 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:31.513978 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:31.514324 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:31.516350 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:31.517639 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:31.519557 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:31.520243 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:31.520492 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:31.525464 (+ 4972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:31.525472 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:31.525487 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:31.525524 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:31.528987 (+ 3463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:31.529745 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:31.529753 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:31.529759 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:31.529942 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:31.530357 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:31.530362 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:31.530365 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:31.530944 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:31.531302 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:31.531758 (+ 456us) server_negotiation.cc:299] Negotiation successful
0809 06:53:31.532207 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":395,"threads_started":1}
I20260809 06:53:31.534735 22105 raft_consensus.cc:348] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acbb09ca3efe49cbaa30f1969999793e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41541 } }
I20260809 06:53:31.535158 22105 raft_consensus.cc:374] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:53:31.535300 22105 raft_consensus.cc:729] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acbb09ca3efe49cbaa30f1969999793e, State: Initialized, Role: FOLLOWER
I20260809 06:53:31.535945 22105 consensus_queue.cc:260] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acbb09ca3efe49cbaa30f1969999793e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41541 } }
I20260809 06:53:31.536221 22105 raft_consensus.cc:388] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:53:31.536399 22105 raft_consensus.cc:482] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:53:31.536585 22105 raft_consensus.cc:3037] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:53:31.538816 22105 raft_consensus.cc:504] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acbb09ca3efe49cbaa30f1969999793e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41541 } }
I20260809 06:53:31.539351 22105 leader_election.cc:302] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: acbb09ca3efe49cbaa30f1969999793e; no voters:
I20260809 06:53:31.540073 22105 leader_election.cc:288] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:53:31.540218 22110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:53:31.541118 22110 raft_consensus.cc:686] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [term 1 LEADER]: Becoming Leader. State: Replica: acbb09ca3efe49cbaa30f1969999793e, State: Running, Role: LEADER
I20260809 06:53:31.541728 22110 consensus_queue.cc:237] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acbb09ca3efe49cbaa30f1969999793e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41541 } }
I20260809 06:53:31.542578 22105 sys_catalog.cc:564] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:53:31.544636 22111 sys_catalog.cc:455] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "acbb09ca3efe49cbaa30f1969999793e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acbb09ca3efe49cbaa30f1969999793e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41541 } } }
I20260809 06:53:31.545049 22111 sys_catalog.cc:458] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [sys.catalog]: This master's current role is: LEADER
I20260809 06:53:31.545827 22112 sys_catalog.cc:455] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [sys.catalog]: SysCatalogTable state changed. Reason: New leader acbb09ca3efe49cbaa30f1969999793e. Latest consensus state: current_term: 1 leader_uuid: "acbb09ca3efe49cbaa30f1969999793e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acbb09ca3efe49cbaa30f1969999793e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41541 } } }
I20260809 06:53:31.546232 22112 sys_catalog.cc:458] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e [sys.catalog]: This master's current role is: LEADER
I20260809 06:53:31.546056 22116 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:53:31.551484 22116 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:53:31.561005 22116 catalog_manager.cc:1347] Generated new cluster ID: 05c5fb7d5c764238b430c4e510308324
I20260809 06:53:31.561144 22116 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:53:31.577772 22116 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:53:31.579088 22116 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:53:31.589258 22116 catalog_manager.cc:5868] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e: Generated new TSK 0
I20260809 06:53:31.590149 22116 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:53:31.660737 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:41541
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:53:32.008649 22133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:32.008945 22133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:32.009043 22133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:32.016578 22133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:32.016702 22133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:32.016819 22133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:53:32.026757 22133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:41541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:32.028117 22133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:32.029567 22133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:32.043107 22138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:32.043171 22141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:32.043148 22139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:32.044170 22133 server_base.cc:1034] running on GCE node
I20260809 06:53:32.044965 22133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:32.046044 22133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:32.047302 22133 hybrid_clock.cc:648] HybridClock initialized: now 1786258412047260 us; error 59 us; skew 500 ppm
I20260809 06:53:32.047638 22133 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:53:32 dist-test-slave-0b58 krb5kdc[22023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258412, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:53:32.050932 22133 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:53:32.052481 22133 webserver.cc:460] Webserver started at http://127.10.205.65:38929/ using document root <none> and password file <none>
I20260809 06:53:32.053200 22133 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:32.053354 22133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:32.053663 22133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:32.056840 22133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "4b043aac409f488da81e26f749fe5ef6"
format_stamp: "Formatted at 2026-08-09 06:53:32 on dist-test-slave-0b58"
server_key: "04668df0649b698c19ba0eea5cd38b9d"
server_key_iv: "884e7ac61a5ca7d56166f679fc84109a"
server_key_version: "encryptionkey@0"
I20260809 06:53:32.057632 22133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "4b043aac409f488da81e26f749fe5ef6"
format_stamp: "Formatted at 2026-08-09 06:53:32 on dist-test-slave-0b58"
server_key: "04668df0649b698c19ba0eea5cd38b9d"
server_key_iv: "884e7ac61a5ca7d56166f679fc84109a"
server_key_version: "encryptionkey@0"
I20260809 06:53:32.063237 22133 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:53:32.066946 22148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:32.068523 22133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:53:32.068710 22133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "4b043aac409f488da81e26f749fe5ef6"
format_stamp: "Formatted at 2026-08-09 06:53:32 on dist-test-slave-0b58"
server_key: "04668df0649b698c19ba0eea5cd38b9d"
server_key_iv: "884e7ac61a5ca7d56166f679fc84109a"
server_key_version: "encryptionkey@0"
I20260809 06:53:32.068953 22133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:32.104399 22133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:32.108873 22133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:32.109169 22133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:32.110307 22133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:32.111658 22133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:32.111740 22133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:32.111842 22133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:32.111888 22133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:32.146695 22133 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:38581
I20260809 06:53:32.146742 22265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:38581 every 8 connection(s)
I20260809 06:53:32.148061 22133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:53:32.150847 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 22133
I20260809 06:53:32.151090 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:53:32.151988 11061 external_mini_cluster.cc:1428] Setting key 2e4ca7da4eb143a6339024c076f9a1b7
Aug 09 06:53:32 dist-test-slave-0b58 krb5kdc[22023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258412, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:53:32.169732 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:32.150707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:42349 (local address 127.10.205.126:41541)
0809 06:53:32.151242 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:32.151247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:32.152563 (+ 1316us) server_negotiation.cc:407] Connection header received
0809 06:53:32.154721 (+ 2158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:32.154726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:32.154826 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:32.154943 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:32.156676 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:32.157395 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:32.159012 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:32.159434 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:32.159572 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:32.163446 (+ 3874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:32.163451 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:32.163454 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:32.163489 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:32.166406 (+ 2917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:32.167220 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:32.167225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:32.167228 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:32.167358 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:32.167855 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:32.167860 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:32.167862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:32.168147 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:32.168347 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:32.169102 (+ 755us) server_negotiation.cc:299] Negotiation successful
0809 06:53:32.169349 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":270,"threads_started":1}
I20260809 06:53:32.170784 22269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:32.151478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:41541 (local address 127.10.205.65:42349)
0809 06:53:32.152395 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:32.152435 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:32.154407 (+ 1972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:32.155197 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:32.155206 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:32.155777 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:32.156502 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:32.156523 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:32.157557 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:32.157561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:32.158855 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:32.158867 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:32.159670 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:32.159677 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:32.159911 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:32.160681 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:32.160709 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:32.163197 (+ 2488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:53:32.166571 (+ 3374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:53:32.166581 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:53:32.166601 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:53:32.167068 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:53:32.167481 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:53:32.167486 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:53:32.167489 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:53:32.167704 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:53:32.168314 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:53:32.168323 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:53:32.168698 (+ 375us) client_negotiation.cc:769] Sending connection context
0809 06:53:32.168989 (+ 291us) client_negotiation.cc:240] Negotiation successful
0809 06:53:32.169568 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":352,"threads_started":1}
I20260809 06:53:32.172619 22266 heartbeater.cc:347] Connected to a master server at 127.10.205.126:41541
I20260809 06:53:32.172946 22266 heartbeater.cc:464] Registering TS with master...
I20260809 06:53:32.173992 22266 heartbeater.cc:511] Master 127.10.205.126:41541 requested a full tablet report, sending...
I20260809 06:53:32.176605 22069 ts_manager.cc:194] Registered new tserver with Master: 4b043aac409f488da81e26f749fe5ef6 (127.10.205.65:38581)
I20260809 06:53:32.178889 22069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:42349
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:53:32.219434 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:41541
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:53:32.564023 22272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:32.564357 22272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:32.564458 22272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:32.571987 22272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:32.572119 22272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:32.572234 22272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:53:32.582398 22272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:41541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:32.583853 22272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:32.585310 22272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:32.599408 22280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:32.599488 22277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:32.599429 22278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:32.605736 22272 server_base.cc:1034] running on GCE node
I20260809 06:53:32.606513 22272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:32.607575 22272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:32.608811 22272 hybrid_clock.cc:648] HybridClock initialized: now 1786258412608759 us; error 46 us; skew 500 ppm
I20260809 06:53:32.609150 22272 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:53:32 dist-test-slave-0b58 krb5kdc[22023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258412, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:53:32.612421 22272 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:53:32.614075 22272 webserver.cc:460] Webserver started at http://127.10.205.66:34509/ using document root <none> and password file <none>
I20260809 06:53:32.614789 22272 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:32.614892 22272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:32.615152 22272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:32.618211 22272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "a6957cc3ab834c21a30f70bc02a3ee48"
format_stamp: "Formatted at 2026-08-09 06:53:32 on dist-test-slave-0b58"
server_key: "4f19996e1d444d90a4a172830bd2081d"
server_key_iv: "140c5cd7acbc3f942a80126d21059465"
server_key_version: "encryptionkey@0"
I20260809 06:53:32.618947 22272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "a6957cc3ab834c21a30f70bc02a3ee48"
format_stamp: "Formatted at 2026-08-09 06:53:32 on dist-test-slave-0b58"
server_key: "4f19996e1d444d90a4a172830bd2081d"
server_key_iv: "140c5cd7acbc3f942a80126d21059465"
server_key_version: "encryptionkey@0"
I20260809 06:53:32.624362 22272 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 06:53:32.627875 22288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:32.629314 22272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 06:53:32.629448 22272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "a6957cc3ab834c21a30f70bc02a3ee48"
format_stamp: "Formatted at 2026-08-09 06:53:32 on dist-test-slave-0b58"
server_key: "4f19996e1d444d90a4a172830bd2081d"
server_key_iv: "140c5cd7acbc3f942a80126d21059465"
server_key_version: "encryptionkey@0"
I20260809 06:53:32.629627 22272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:32.660900 22272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:32.665061 22272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:32.665333 22272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:32.666402 22272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:32.667747 22272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:32.667824 22272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:32.667912 22272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:32.667956 22272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:32.702354 22272 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:35355
I20260809 06:53:32.702404 22406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:35355 every 8 connection(s)
I20260809 06:53:32.703732 22272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:53:32.711737 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 22272
I20260809 06:53:32.711925 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:53:32.712450 11061 external_mini_cluster.cc:1428] Setting key 6533b344376e67ba8e8b58a921f82237
Aug 09 06:53:32 dist-test-slave-0b58 krb5kdc[22023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258412, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:53:32.724624 22409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:32.706265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:35585 (local address 127.10.205.126:41541)
0809 06:53:32.706754 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:32.706758 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:32.707571 (+ 813us) server_negotiation.cc:407] Connection header received
0809 06:53:32.709506 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:32.709512 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:32.709609 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:32.709731 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:32.711241 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:32.712150 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:32.714058 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:32.714675 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:32.714822 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:32.718697 (+ 3875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:32.718702 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:32.718705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:32.718738 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:32.721389 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:32.722175 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:32.722180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:32.722182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:32.722322 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:32.722786 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:32.722792 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:32.722795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:32.723074 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:32.723238 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:32.723964 (+ 726us) server_negotiation.cc:299] Negotiation successful
0809 06:53:32.724201 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":263,"threads_started":1}
I20260809 06:53:32.725687 22410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:32.706685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:41541 (local address 127.10.205.66:35585)
0809 06:53:32.707401 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:32.707448 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:32.709226 (+ 1778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:32.709985 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:32.709994 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:32.710503 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:32.711062 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:32.711080 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:32.712350 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:32.712355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:32.713904 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:32.713917 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:32.714933 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:32.714941 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:32.715187 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:32.715926 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:32.715949 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:32.718446 (+ 2497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:53:32.721544 (+ 3098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:53:32.721554 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:53:32.721572 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:53:32.722025 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:53:32.722443 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:53:32.722448 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:53:32.722452 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:53:32.722654 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:53:32.723212 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:53:32.723220 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:53:32.723590 (+ 370us) client_negotiation.cc:769] Sending connection context
0809 06:53:32.723873 (+ 283us) client_negotiation.cc:240] Negotiation successful
0809 06:53:32.724476 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":276,"threads_started":1}
I20260809 06:53:32.727258 22407 heartbeater.cc:347] Connected to a master server at 127.10.205.126:41541
I20260809 06:53:32.727586 22407 heartbeater.cc:464] Registering TS with master...
I20260809 06:53:32.728415 22407 heartbeater.cc:511] Master 127.10.205.126:41541 requested a full tablet report, sending...
I20260809 06:53:32.729995 22069 ts_manager.cc:194] Registered new tserver with Master: a6957cc3ab834c21a30f70bc02a3ee48 (127.10.205.66:35355)
I20260809 06:53:32.730855 22069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:35585
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:53:32.777896 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:41541
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:53:33.123204 22413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:53:33.123584 22413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:53:33.123772 22413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:53:33.131524 22413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:53:33.131695 22413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:53:33.131879 22413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:53:33.142604 22413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:41541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:53:33.144179 22413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:53:33.145670 22413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:53:33.159219 22418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:33.159320 22420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:53:33.159296 22422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:53:33.160187 22413 server_base.cc:1034] running on GCE node
I20260809 06:53:33.160897 22413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:53:33.161844 22413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:53:33.163049 22413 hybrid_clock.cc:648] HybridClock initialized: now 1786258413163010 us; error 26 us; skew 500 ppm
I20260809 06:53:33.163395 22413 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:53:33 dist-test-slave-0b58 krb5kdc[22023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258413, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:53:33.166734 22413 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:53:33.168627 22413 webserver.cc:460] Webserver started at http://127.10.205.67:41049/ using document root <none> and password file <none>
I20260809 06:53:33.169432 22413 fs_manager.cc:359] Metadata directory not provided
I20260809 06:53:33.169579 22413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:53:33.169945 22413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:53:33.173403 22413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "3ef841cdede44dae8129af02f80b3b9e"
format_stamp: "Formatted at 2026-08-09 06:53:33 on dist-test-slave-0b58"
server_key: "af4a36cd21435560f85f8ca1a5fb806d"
server_key_iv: "bd99c5653f89f3640be1e52554e67cdd"
server_key_version: "encryptionkey@0"
I20260809 06:53:33.174257 22413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "3ef841cdede44dae8129af02f80b3b9e"
format_stamp: "Formatted at 2026-08-09 06:53:33 on dist-test-slave-0b58"
server_key: "af4a36cd21435560f85f8ca1a5fb806d"
server_key_iv: "bd99c5653f89f3640be1e52554e67cdd"
server_key_version: "encryptionkey@0"
I20260809 06:53:33.180076 22413 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 06:53:33.182217 22266 heartbeater.cc:503] Master 127.10.205.126:41541 was elected leader, sending a full tablet report...
I20260809 06:53:33.183920 22429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:33.185469 22413 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:53:33.185652 22413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "3ef841cdede44dae8129af02f80b3b9e"
format_stamp: "Formatted at 2026-08-09 06:53:33 on dist-test-slave-0b58"
server_key: "af4a36cd21435560f85f8ca1a5fb806d"
server_key_iv: "bd99c5653f89f3640be1e52554e67cdd"
server_key_version: "encryptionkey@0"
I20260809 06:53:33.185864 22413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:53:33.203470 22413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:53:33.207614 22413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:53:33.207966 22413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:53:33.209049 22413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:53:33.210433 22413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:53:33.210508 22413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:33.210678 22413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:53:33.210731 22413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:53:33.246415 22413 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:35171
I20260809 06:53:33.246450 22548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:35171 every 8 connection(s)
I20260809 06:53:33.247772 22413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:53:33.249091 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 22413
I20260809 06:53:33.249270 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:53:33.249732 11061 external_mini_cluster.cc:1428] Setting key 85601ce70b697f4ad275a68b8fd1aa47
Aug 09 06:53:33 dist-test-slave-0b58 krb5kdc[22023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258413, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:53:33.268805 22551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.250644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:52797 (local address 127.10.205.126:41541)
0809 06:53:33.251211 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:33.251217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:33.252349 (+ 1132us) server_negotiation.cc:407] Connection header received
0809 06:53:33.254200 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:33.254203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:33.254277 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:33.254367 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:33.255928 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.256803 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.258325 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.258699 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.258800 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.262246 (+ 3446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:33.262250 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:33.262258 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:33.262296 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:33.265917 (+ 3621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:33.266613 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:33.266617 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:33.266619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:33.266733 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:33.267168 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:33.267173 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:33.267176 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:33.267490 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:33.267610 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:33.268312 (+ 702us) server_negotiation.cc:299] Negotiation successful
0809 06:53:33.268514 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":283,"threads_started":1}
I20260809 06:53:33.269754 22552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.251353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:41541 (local address 127.10.205.67:52797)
0809 06:53:33.252179 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:33.252224 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:33.253967 (+ 1743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:33.254606 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:33.254614 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:33.255194 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:53:33.255765 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:33.255783 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.256935 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.256939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:33.258194 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:33.258207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.258893 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.258898 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:33.259099 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.259742 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:53:33.259769 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:53:33.262042 (+ 2273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:53:33.266042 (+ 4000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:53:33.266049 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:53:33.266061 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:53:33.266515 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:53:33.266830 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:53:33.266833 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:53:33.266836 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:53:33.267034 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:53:33.267607 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:53:33.267613 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:53:33.267944 (+ 331us) client_negotiation.cc:769] Sending connection context
0809 06:53:33.268182 (+ 238us) client_negotiation.cc:240] Negotiation successful
0809 06:53:33.268657 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":353,"threads_started":1}
I20260809 06:53:33.271201 22549 heartbeater.cc:347] Connected to a master server at 127.10.205.126:41541
I20260809 06:53:33.271528 22549 heartbeater.cc:464] Registering TS with master...
I20260809 06:53:33.272379 22549 heartbeater.cc:511] Master 127.10.205.126:41541 requested a full tablet report, sending...
I20260809 06:53:33.273869 22069 ts_manager.cc:194] Registered new tserver with Master: 3ef841cdede44dae8129af02f80b3b9e (127.10.205.67:35171)
I20260809 06:53:33.274680 22069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:52797
I20260809 06:53:33.277865 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:53:33.294474 22551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.282370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58982 (local address 127.10.205.126:41541)
0809 06:53:33.282536 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:33.282540 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:33.283111 (+ 571us) server_negotiation.cc:407] Connection header received
0809 06:53:33.283270 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:33.283274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:33.283346 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:33.283416 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:33.284880 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.285607 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.286846 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.287253 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.287355 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.289773 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:33.289778 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:33.289781 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:33.289815 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:33.292225 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:33.292895 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:33.292899 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:33.292901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:33.293009 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:33.293322 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:33.293325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:33.293327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:33.293655 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:33.293831 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:33.294100 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 06:53:33.294258 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:53:33.298602 22069 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58982:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:53:33.305452 22069 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:53:33.341519 22566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.317718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34558 (local address 127.10.205.66:35355)
0809 06:53:33.331194 (+ 13476us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:33.331207 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:33.331253 (+ 46us) server_negotiation.cc:407] Connection header received
0809 06:53:33.331400 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:33.331413 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:33.331828 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:33.333368 (+ 1540us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:53:33.333623 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.335418 (+ 1795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.338578 (+ 3160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.340192 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.340396 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.340607 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:33.340933 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 06:53:33.341100 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13219,"thread_start_us":14330,"threads_started":1}
I20260809 06:53:33.341728 22565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.317419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:35355 (local address 127.0.0.1:34558)
0809 06:53:33.318354 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:33.318401 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:33.318577 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:33.332427 (+ 13850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:33.332437 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:33.332481 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:53:33.333033 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:33.333047 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.335587 (+ 2540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.335594 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:33.338403 (+ 2809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:33.338418 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.340444 (+ 2026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.340450 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:33.340643 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.340703 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 06:53:33.340877 (+ 174us) client_negotiation.cc:240] Negotiation successful
0809 06:53:33.341085 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"mutex_wait_us":89,"spinlock_wait_cycles":22912,"thread_start_us":16210,"threads_started":1}
I20260809 06:53:33.342520 22567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.318213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34016 (local address 127.10.205.67:35171)
0809 06:53:33.330586 (+ 12373us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:33.330600 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:33.332783 (+ 2183us) server_negotiation.cc:407] Connection header received
0809 06:53:33.332901 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:33.332910 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:33.333143 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:33.333327 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:53:33.334618 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.336213 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.338794 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.340237 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.340399 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.340648 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:33.341956 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0809 06:53:33.342177 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12130,"thread_start_us":11944,"threads_started":1}
I20260809 06:53:33.342811 22564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.317572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:35171 (local address 127.0.0.1:34016)
0809 06:53:33.332459 (+ 14887us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:33.332485 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:33.332625 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:33.333947 (+ 1322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:33.333951 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:33.333981 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:53:33.334397 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:33.334411 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.336410 (+ 1999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.336422 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:33.338636 (+ 2214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:33.338645 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.340783 (+ 2138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.340795 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:33.340979 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.341014 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 06:53:33.341099 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 06:53:33.341229 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14741,"spinlock_wait_cycles":6400,"thread_start_us":914,"threads_started":1}
I20260809 06:53:33.344966 22568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.319675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:38581 (local address 127.0.0.1:36240)
0809 06:53:33.335210 (+ 15535us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:33.335239 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:33.335349 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:33.337328 (+ 1979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:33.337333 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:33.337359 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:53:33.337859 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:33.337870 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.339730 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.339734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:33.341927 (+ 2193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:33.341941 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.344155 (+ 2214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.344164 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:33.344396 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.344431 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 06:53:33.344521 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 06:53:33.344649 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15413,"thread_start_us":15255,"threads_started":1}
I20260809 06:53:33.345302 22569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.320314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36240 (local address 127.10.205.65:38581)
0809 06:53:33.336781 (+ 16467us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:33.336805 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:33.336827 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:53:33.336912 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:33.336918 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:33.337083 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:33.337332 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:53:33.338060 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.339551 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.342101 (+ 2550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.343599 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.343742 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.343980 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:33.344759 (+ 779us) server_negotiation.cc:299] Negotiation successful
0809 06:53:33.344956 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16311,"thread_start_us":17199,"threads_started":1}
I20260809 06:53:33.346269 22340 tablet_service.cc:1467] Processing CreateTablet for tablet 2f0b86454a1f40bbb41a23d0d589851b (DEFAULT_TABLE table=test-table [id=1275615698b8410ea38724e0ead2629c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:53:33.346643 22481 tablet_service.cc:1467] Processing CreateTablet for tablet 2f0b86454a1f40bbb41a23d0d589851b (DEFAULT_TABLE table=test-table [id=1275615698b8410ea38724e0ead2629c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:53:33.347867 22481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f0b86454a1f40bbb41a23d0d589851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:53:33.347888 22340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f0b86454a1f40bbb41a23d0d589851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:53:33.348939 22199 tablet_service.cc:1467] Processing CreateTablet for tablet 2f0b86454a1f40bbb41a23d0d589851b (DEFAULT_TABLE table=test-table [id=1275615698b8410ea38724e0ead2629c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:53:33.350234 22199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f0b86454a1f40bbb41a23d0d589851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:53:33.360040 22570 tablet_bootstrap.cc:492] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e: Bootstrap starting.
I20260809 06:53:33.363862 22570 tablet_bootstrap.cc:654] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e: Neither blocks nor log segments found. Creating new log.
I20260809 06:53:33.365020 22570 log.cc:824] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:53:33.368578 22571 tablet_bootstrap.cc:492] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48: Bootstrap starting.
I20260809 06:53:33.373215 22572 tablet_bootstrap.cc:492] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6: Bootstrap starting.
I20260809 06:53:33.375243 22571 tablet_bootstrap.cc:654] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48: Neither blocks nor log segments found. Creating new log.
I20260809 06:53:33.376161 22570 tablet_bootstrap.cc:492] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e: No bootstrap required, opened a new log
I20260809 06:53:33.376506 22570 ts_tablet_manager.cc:1397] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.011s
I20260809 06:53:33.376695 22571 log.cc:824] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48: Log is configured to *not* fsync() on all Append() calls
I20260809 06:53:33.378227 22572 tablet_bootstrap.cc:654] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6: Neither blocks nor log segments found. Creating new log.
I20260809 06:53:33.379612 22572 log.cc:824] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6: Log is configured to *not* fsync() on all Append() calls
I20260809 06:53:33.380121 22571 tablet_bootstrap.cc:492] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48: No bootstrap required, opened a new log
I20260809 06:53:33.380493 22571 ts_tablet_manager.cc:1397] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260809 06:53:33.383013 22572 tablet_bootstrap.cc:492] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6: No bootstrap required, opened a new log
I20260809 06:53:33.383327 22572 ts_tablet_manager.cc:1397] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260809 06:53:33.385681 22570 raft_consensus.cc:348] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 35355 } } peers { permanent_uuid: "3ef841cdede44dae8129af02f80b3b9e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35171 } } peers { permanent_uuid: "4b043aac409f488da81e26f749fe5ef6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 38581 } }
I20260809 06:53:33.386168 22570 raft_consensus.cc:374] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:53:33.386297 22570 raft_consensus.cc:729] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef841cdede44dae8129af02f80b3b9e, State: Initialized, Role: FOLLOWER
I20260809 06:53:33.386932 22570 consensus_queue.cc:260] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 35355 } } peers { permanent_uuid: "3ef841cdede44dae8129af02f80b3b9e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35171 } } peers { permanent_uuid: "4b043aac409f488da81e26f749fe5ef6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 38581 } }
I20260809 06:53:33.388113 22549 heartbeater.cc:503] Master 127.10.205.126:41541 was elected leader, sending a full tablet report...
I20260809 06:53:33.388935 22570 ts_tablet_manager.cc:1428] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260809 06:53:33.393702 22571 raft_consensus.cc:348] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 35355 } } peers { permanent_uuid: "3ef841cdede44dae8129af02f80b3b9e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35171 } } peers { permanent_uuid: "4b043aac409f488da81e26f749fe5ef6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 38581 } }
I20260809 06:53:33.394229 22571 raft_consensus.cc:374] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:53:33.394366 22571 raft_consensus.cc:729] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6957cc3ab834c21a30f70bc02a3ee48, State: Initialized, Role: FOLLOWER
I20260809 06:53:33.394258 22572 raft_consensus.cc:348] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 35355 } } peers { permanent_uuid: "3ef841cdede44dae8129af02f80b3b9e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35171 } } peers { permanent_uuid: "4b043aac409f488da81e26f749fe5ef6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 38581 } }
I20260809 06:53:33.394690 22572 raft_consensus.cc:374] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:53:33.394817 22572 raft_consensus.cc:729] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b043aac409f488da81e26f749fe5ef6, State: Initialized, Role: FOLLOWER
I20260809 06:53:33.395108 22571 consensus_queue.cc:260] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 35355 } } peers { permanent_uuid: "3ef841cdede44dae8129af02f80b3b9e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35171 } } peers { permanent_uuid: "4b043aac409f488da81e26f749fe5ef6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 38581 } }
I20260809 06:53:33.395383 22572 consensus_queue.cc:260] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 35355 } } peers { permanent_uuid: "3ef841cdede44dae8129af02f80b3b9e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35171 } } peers { permanent_uuid: "4b043aac409f488da81e26f749fe5ef6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 38581 } }
I20260809 06:53:33.397634 22572 ts_tablet_manager.cc:1428] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260809 06:53:33.398209 22407 heartbeater.cc:503] Master 127.10.205.126:41541 was elected leader, sending a full tablet report...
I20260809 06:53:33.398931 22571 ts_tablet_manager.cc:1428] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48: Time spent starting tablet: real 0.018s user 0.007s sys 0.008s
W20260809 06:53:33.400951 22267 tablet.cc:2369] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:53:33.455919 22408 tablet.cc:2369] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:53:33.499503 22550 tablet.cc:2369] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:53:33.506491 22577 raft_consensus.cc:482] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:53:33.506816 22577 raft_consensus.cc:504] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 35355 } } peers { permanent_uuid: "3ef841cdede44dae8129af02f80b3b9e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35171 } } peers { permanent_uuid: "4b043aac409f488da81e26f749fe5ef6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 38581 } }
I20260809 06:53:33.508930 22577 leader_election.cc:288] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ef841cdede44dae8129af02f80b3b9e (127.10.205.67:35171), 4b043aac409f488da81e26f749fe5ef6 (127.10.205.65:38581)
I20260809 06:53:33.517458 22569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.509590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:48685 (local address 127.10.205.65:38581)
0809 06:53:33.509873 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:33.509880 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:33.510512 (+ 632us) server_negotiation.cc:407] Connection header received
0809 06:53:33.510741 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:33.510746 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:33.510822 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:33.510906 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:53:33.511696 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.512830 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.515232 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.516544 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.516702 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.516754 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:33.517105 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 06:53:33.517233 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260809 06:53:33.517441 22567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.509516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:37045 (local address 127.10.205.67:35171)
0809 06:53:33.509703 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:33.509709 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:33.510367 (+ 658us) server_negotiation.cc:407] Connection header received
0809 06:53:33.510693 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:33.510698 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:33.510780 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:33.510884 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:53:33.511547 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.512461 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.515067 (+ 2606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.516387 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.516559 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.516654 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:33.517014 (+ 360us) server_negotiation.cc:299] Negotiation successful
0809 06:53:33.517169 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:53:33.517627 22580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.509188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:38581 (local address 127.10.205.66:48685)
0809 06:53:33.510387 (+ 1199us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:33.510409 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:33.510548 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:33.511062 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:33.511072 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:33.511098 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:53:33.511516 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:33.511528 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.512966 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.512971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:33.515076 (+ 2105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:33.515085 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.516745 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.516752 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:33.516937 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.516977 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 06:53:33.517050 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 06:53:33.517147 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1071,"mutex_wait_us":188,"thread_start_us":683,"threads_started":1}
I20260809 06:53:33.518036 22579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.509188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:35171 (local address 127.10.205.66:37045)
0809 06:53:33.510241 (+ 1053us) negotiation.cc:107] Waiting for socket to connect
0809 06:53:33.510258 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:53:33.510447 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:53:33.510911 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:53:33.510916 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:53:33.510939 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:53:33.511368 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:33.511384 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.512588 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.512595 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:33.514891 (+ 2296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:53:33.514906 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.516596 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.516622 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:53:33.516836 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.516880 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 06:53:33.516977 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 06:53:33.517126 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":904,"thread_start_us":659,"threads_started":1}
I20260809 06:53:33.518675 22219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0b86454a1f40bbb41a23d0d589851b" candidate_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b043aac409f488da81e26f749fe5ef6" is_pre_election: true
I20260809 06:53:33.519028 22501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0b86454a1f40bbb41a23d0d589851b" candidate_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef841cdede44dae8129af02f80b3b9e" is_pre_election: true
I20260809 06:53:33.519191 22219 raft_consensus.cc:2454] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6957cc3ab834c21a30f70bc02a3ee48 in term 0.
I20260809 06:53:33.519521 22501 raft_consensus.cc:2454] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6957cc3ab834c21a30f70bc02a3ee48 in term 0.
I20260809 06:53:33.519973 22292 leader_election.cc:302] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b043aac409f488da81e26f749fe5ef6, a6957cc3ab834c21a30f70bc02a3ee48; no voters:
I20260809 06:53:33.520427 22577 raft_consensus.cc:2781] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:53:33.520587 22577 raft_consensus.cc:482] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:53:33.520710 22577 raft_consensus.cc:3037] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:53:33.522949 22577 raft_consensus.cc:504] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 35355 } } peers { permanent_uuid: "3ef841cdede44dae8129af02f80b3b9e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35171 } } peers { permanent_uuid: "4b043aac409f488da81e26f749fe5ef6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 38581 } }
I20260809 06:53:33.523684 22577 leader_election.cc:288] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [CANDIDATE]: Term 1 election: Requested vote from peers 3ef841cdede44dae8129af02f80b3b9e (127.10.205.67:35171), 4b043aac409f488da81e26f749fe5ef6 (127.10.205.65:38581)
I20260809 06:53:33.524143 22219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0b86454a1f40bbb41a23d0d589851b" candidate_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b043aac409f488da81e26f749fe5ef6"
I20260809 06:53:33.524178 22501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f0b86454a1f40bbb41a23d0d589851b" candidate_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef841cdede44dae8129af02f80b3b9e"
I20260809 06:53:33.524385 22219 raft_consensus.cc:3037] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:53:33.524426 22501 raft_consensus.cc:3037] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:53:33.526706 22501 raft_consensus.cc:2454] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6957cc3ab834c21a30f70bc02a3ee48 in term 1.
I20260809 06:53:33.526712 22219 raft_consensus.cc:2454] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6957cc3ab834c21a30f70bc02a3ee48 in term 1.
I20260809 06:53:33.527174 22290 leader_election.cc:302] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef841cdede44dae8129af02f80b3b9e, a6957cc3ab834c21a30f70bc02a3ee48; no voters:
I20260809 06:53:33.527534 22577 raft_consensus.cc:2781] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:53:33.528015 22577 raft_consensus.cc:686] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 1 LEADER]: Becoming Leader. State: Replica: a6957cc3ab834c21a30f70bc02a3ee48, State: Running, Role: LEADER
I20260809 06:53:33.528576 22577 consensus_queue.cc:237] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 35355 } } peers { permanent_uuid: "3ef841cdede44dae8129af02f80b3b9e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35171 } } peers { permanent_uuid: "4b043aac409f488da81e26f749fe5ef6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 38581 } }
I20260809 06:53:33.533555 22068 catalog_manager.cc:5495] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6957cc3ab834c21a30f70bc02a3ee48 (127.10.205.66). New cstate: current_term: 1 leader_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6957cc3ab834c21a30f70bc02a3ee48" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ef841cdede44dae8129af02f80b3b9e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b043aac409f488da81e26f749fe5ef6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 38581 } health_report { overall_health: UNKNOWN } } }
I20260809 06:53:33.583272 22566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.577981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34570 (local address 127.10.205.66:35355)
0809 06:53:33.578180 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:33.578184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:33.578258 (+ 74us) server_negotiation.cc:407] Connection header received
0809 06:53:33.578441 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:33.578444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:33.578527 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:33.578657 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:53:33.578993 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.579724 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.581205 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.581611 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.581702 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.582197 (+ 495us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:53:33.582744 (+ 547us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:53:33.582873 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:33.582954 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 06:53:33.583036 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:53:33.591881 22501 raft_consensus.cc:1261] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e [term 1 FOLLOWER]: Refusing update from remote peer a6957cc3ab834c21a30f70bc02a3ee48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:53:33.591879 22219 raft_consensus.cc:1261] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6 [term 1 FOLLOWER]: Refusing update from remote peer a6957cc3ab834c21a30f70bc02a3ee48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:53:33.593099 22581 consensus_queue.cc:1035] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef841cdede44dae8129af02f80b3b9e" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 35171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:53:33.593502 22577 consensus_queue.cc:1035] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b043aac409f488da81e26f749fe5ef6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:53:33.622648 22069 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:53:33.622957 22069 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:53:33.626817 22069 catalog_manager.cc:5782] T 00000000000000000000000000000000 P acbb09ca3efe49cbaa30f1969999793e: Sending DeleteTablet for 3 replicas of tablet 2f0b86454a1f40bbb41a23d0d589851b
I20260809 06:53:33.628051 22199 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f0b86454a1f40bbb41a23d0d589851b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:53:33 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:36240
I20260809 06:53:33.628024 22340 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f0b86454a1f40bbb41a23d0d589851b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:53:33 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:34558
I20260809 06:53:33.628108 22481 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f0b86454a1f40bbb41a23d0d589851b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:53:33 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:34016
I20260809 06:53:33.629199 22596 tablet_replica.cc:330] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6: stopping tablet replica
I20260809 06:53:33.629781 22595 tablet_replica.cc:330] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48: stopping tablet replica
I20260809 06:53:33.630242 22595 raft_consensus.cc:2229] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:53:33.630343 22596 raft_consensus.cc:2229] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:53:33.630613 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 22133
I20260809 06:53:33.630864 22596 raft_consensus.cc:2258] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:53:33.630899 22595 raft_consensus.cc:2258] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:53:33.632066 22594 tablet_replica.cc:330] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e: stopping tablet replica
I20260809 06:53:33.632529 22594 raft_consensus.cc:2229] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:53:33.633037 22594 raft_consensus.cc:2258] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:53:33.633883 22596 ts_tablet_manager.cc:1905] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:53:33.635248 22594 ts_tablet_manager.cc:1905] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:53:33.642166 22595 ts_tablet_manager.cc:1905] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:53:33.643296 22594 ts_tablet_manager.cc:1918] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:53:33.643483 22594 log.cc:1196] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/2f0b86454a1f40bbb41a23d0d589851b
I20260809 06:53:33.644109 22594 ts_tablet_manager.cc:1939] T 2f0b86454a1f40bbb41a23d0d589851b P 3ef841cdede44dae8129af02f80b3b9e: Deleting consensus metadata
I20260809 06:53:33.647043 22053 catalog_manager.cc:4841] TS 3ef841cdede44dae8129af02f80b3b9e (127.10.205.67:35171): tablet 2f0b86454a1f40bbb41a23d0d589851b (table test-table [id=1275615698b8410ea38724e0ead2629c]) successfully deleted
I20260809 06:53:33.649780 22595 ts_tablet_manager.cc:1918] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:53:33.649844 22596 ts_tablet_manager.cc:1918] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:53:33.650002 22595 log.cc:1196] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/2f0b86454a1f40bbb41a23d0d589851b
I20260809 06:53:33.650014 22596 log.cc:1196] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/2f0b86454a1f40bbb41a23d0d589851b
I20260809 06:53:33.650599 22595 ts_tablet_manager.cc:1939] T 2f0b86454a1f40bbb41a23d0d589851b P a6957cc3ab834c21a30f70bc02a3ee48: Deleting consensus metadata
I20260809 06:53:33.650632 22596 ts_tablet_manager.cc:1939] T 2f0b86454a1f40bbb41a23d0d589851b P 4b043aac409f488da81e26f749fe5ef6: Deleting consensus metadata
I20260809 06:53:33.652577 22055 catalog_manager.cc:4841] TS 4b043aac409f488da81e26f749fe5ef6 (127.10.205.65:38581): tablet 2f0b86454a1f40bbb41a23d0d589851b (table test-table [id=1275615698b8410ea38724e0ead2629c]) successfully deleted
I20260809 06:53:33.652985 22052 catalog_manager.cc:4841] TS a6957cc3ab834c21a30f70bc02a3ee48 (127.10.205.66:35355): tablet 2f0b86454a1f40bbb41a23d0d589851b (table test-table [id=1275615698b8410ea38724e0ead2629c]) successfully deleted
Aug 09 06:53:33 dist-test-slave-0b58 krb5kdc[22023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:53:33.667294 22569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.632880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36246 (local address 127.10.205.65:38581)
0809 06:53:33.633064 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:33.633070 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:33.642973 (+ 9903us) server_negotiation.cc:407] Connection header received
0809 06:53:33.644716 (+ 1743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:33.644728 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:33.644826 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:33.644943 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:33.646921 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.648090 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.650335 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.651048 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.651163 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.661166 (+ 10003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:33.661183 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:33.661199 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:33.661241 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:33.664179 (+ 2938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:33.665002 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:33.665010 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:33.665012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:33.665147 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:33.665612 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:33.665616 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:33.665618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:33.666017 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:33.666366 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:33.666677 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 06:53:33.666917 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 06:53:33.668083 22261 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:33.777071 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 22133
I20260809 06:53:33.798859 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 22272
Aug 09 06:53:33 dist-test-slave-0b58 krb5kdc[22023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:53:33.815102 22566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.799990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34580 (local address 127.10.205.66:35355)
0809 06:53:33.800214 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:33.800218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:33.800233 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:53:33.800335 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:33.800340 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:33.800416 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:33.800524 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:33.801777 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.802620 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.803881 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.804463 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.804615 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.808911 (+ 4296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:33.808925 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:33.808941 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:33.808984 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:33.812112 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:33.812859 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:33.812875 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:33.812878 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:33.813030 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:33.813423 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:33.813430 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:33.813438 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:33.813918 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:33.814239 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:33.814603 (+ 364us) server_negotiation.cc:299] Negotiation successful
0809 06:53:33.814776 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 06:53:33.815979 22402 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:33.933748 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 22272
I20260809 06:53:33.955377 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 22413
Aug 09 06:53:33 dist-test-slave-0b58 krb5kdc[22023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:53:33.970407 22567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:53:33.956203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34020 (local address 127.10.205.67:35171)
0809 06:53:33.956432 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 06:53:33.956437 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:53:33.956455 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:53:33.956632 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:53:33.956637 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:53:33.956710 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:53:33.956790 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:53:33.958049 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.958749 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.959932 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:53:33.960370 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:53:33.960499 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:53:33.964870 (+ 4371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:53:33.964887 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:53:33.964904 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:53:33.964939 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:53:33.967756 (+ 2817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:33.968515 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:33.968523 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:33.968525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:33.968806 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:53:33.969140 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:53:33.969143 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:53:33.969145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:53:33.969490 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:53:33.969721 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 06:53:33.969978 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 06:53:33.970147 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260809 06:53:33.971087 22544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:34.062223 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 22413
I20260809 06:53:34.081749 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 22036
I20260809 06:53:34.082983 22100 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:53:34.196609 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 22036
2026-08-09T06:53:34Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4630 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:53:34 dist-test-slave-0b58 krb5kdc[22604](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:53:34 dist-test-slave-0b58 krb5kdc[22604](info): set up 2 sockets
Aug 09 06:53:34 dist-test-slave-0b58 krb5kdc[22604](info): commencing operation
krb5kdc: starting...
W20260809 06:53:35.356323 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:53:35 dist-test-slave-0b58 krb5kdc[22604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:53:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:53:35Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.205.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.205.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/rangeradmin_127.10.205.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/rangeradmin_127.10.205.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.205.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.205.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/rangerlookup_127.10.205.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/rangerlookup_127.10.205.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.205.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.205.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/HTTP_127.10.205.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/HTTP_127.10.205.84@KRBTEST.COM.keytab.
I20260809 06:53:35.775362 11061 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskDfk6Nc/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/postgres -l logfile start
2026-08-09 06:53:38.342 UTC [22636] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 06:53:38.342 UTC [22636] LOG: listening on IPv4 address "127.10.205.84", port 51161
2026-08-09 06:53:38.346 UTC [22636] LOG: listening on Unix socket "/tmp/.s.PGSQL.51161"
2026-08-09 06:53:38.369 UTC [22639] LOG: database system was shut down at 2026-08-09 06:53:36 UTC
2026-08-09 06:53:38.373 UTC [22636] LOG: database system is ready to accept connections
I20260809 06:53:39.383798 11061 mini_postgres.cc:96] Postgres bound to 51161
2026-08-09 06:53:39.408 UTC [22647] FATAL: database "slave" does not exist
127.10.205.84:51161 - accepting connections
I20260809 06:53:39.409854 11061 mini_ranger.cc:161] Starting Ranger...
I20260809 06:53:39.444695 11061 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 06:53:39.932956 11061 mini_ranger.cc:87] Created ranger Postgres database
I20260809 06:53:39.933151 11061 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-admin
2026-08-09 06:53:40,298 [I] DB FLAVOR :POSTGRES
2026-08-09 06:53:40,299 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 06:53:40,299 [I] Checking connection..
2026-08-09 06:53:40,299 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 06:53:40,536 [I] Checking connection passed.
2026-08-09 06:53:40,536 [I] --------- Verifying version history table ---------
2026-08-09 06:53:40,536 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 06:53:40,792 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 06:53:40,792 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 06:53:41,066 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 06:53:41,066 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 06:53:41,066 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 06:53:41.297 UTC [22715] WARNING: there is no transaction in progress
2026-08-09 06:53:41,304 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 06:53:41,304 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 06:53:41,549 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 06:53:41,549 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 06:53:41,550 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 06:53:41,785 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 06:53:42,056 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-0b58.c.gcp-upstream.internal','N') ;"
2026-08-09 06:53:42,321 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 06:53:42,557 [I] Table x_portal_user does not exist in database ranger
2026-08-09 06:53:42,557 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 06:53:42,789 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 06:53:42,790 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 06:53:43,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 06:53:43,276 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 06:53:43,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 06:53:44.270 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.287 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.303 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.319 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.340 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.362 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.429 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.436 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.451 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.461 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.472 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.487 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.496 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.503 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.510 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:44.517 UTC [22827] WARNING: there is no transaction in progress
2026-08-09 06:53:45,144 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 06:53:45,144 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 06:53:45,376 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 06:53:45,376 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 06:53:45,625 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 06:53:45,626 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 06:53:45,865 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 06:53:45,866 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 06:53:46,130 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 06:53:46,377 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-0b58.c.gcp-upstream.internal';"
2026-08-09 06:53:46,606 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 06:53:46,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 06:53:46,842 [I] DB_PATCHES have already been applied
I20260809 06:53:46.849068 11061 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-admin:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskDfk6Nc/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 06:53:46.849227 11061 mini_ranger.cc:193] Using host: 127.10.205.84
I20260809 06:53:46.871701 11061 mini_ranger.cc:227] Ranger admin URL: http://127.10.205.84:36245
Aug 09, 2026 6:53:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:53:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:53:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 6:53:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 6:53:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 6:53:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 6:53:47 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 06:53:48.070072 11061 mini_ranger.cc:160] Time spent starting Ranger: real 8.660s user 0.000s sys 0.069s
Aug 09, 2026 6:54:08 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 6:54:08 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 6:54:08 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 6:54:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 6:54:08 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 6:54:09 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 06:54:10.435945 11061 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.205.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.205.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/rangerkms_127.10.205.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/rangerkms_127.10.205.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.205.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.205.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.205.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/HTTP_127.10.205.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.205.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/HTTP_127.10.205.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 06:54:10 dist-test-slave-0b58 krb5kdc[22604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258450, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 06:54:10.649976 11061 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 06:54:10.677907 11061 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 06:54:11.545437 11061 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 06:54:11.545593 11061 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-kms
I20260809 06:54:11.545764 11061 mini_ranger_kms.cc:227] Using postgres at 127.10.205.84:51161
2026-08-09 06:54:12,043 [I] DB FLAVOR :POSTGRES
2026-08-09 06:54:12,044 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 06:54:12,044 [I] Checking connection
2026-08-09 06:54:12,044 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 06:54:12,317 [I] connection success
2026-08-09 06:54:12,317 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 06:54:12,317 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 06:54:12,317 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 06:54:12,584 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 06:54:12,585 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 06:54:12,585 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 06:54:12,585 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:51161/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 06:54:12,854 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 06:54:13.298938 11061 mini_ranger_kms.cc:310] Created kms service
I20260809 06:54:13.500985 11061 mini_ranger_kms.cc:326] Created kudu user
I20260809 06:54:13.549281 11061 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 06:54:13 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258450, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:54:13.999013 11061 mini_ranger_kms.cc:384] Added ranger policy
I20260809 06:54:13.999418 11061 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-kms:/tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 06:54:13.999480 11061 mini_ranger_kms.cc:240] Using host: 127.10.205.84
I20260809 06:54:14.027500 11061 mini_ranger_kms.cc:276] Ranger KMS PID: 23018
I20260809 06:54:14.027726 11061 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.205.84:36113
Aug 09, 2026 6:54:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:54:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:54:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 6:54:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 6:54:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 6:54:15 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 06:54:16 dist-test-slave-0b58 krb5kdc[22604](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786258456, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.205.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:54:16.448467 11061 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.799s user 0.127s sys 0.416s
I20260809 06:54:16.448855 11061 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 06:54:16.449126 11061 mini_ranger_kms.cc:401] 127.10.205.84:36113/kms/v1/keys
Aug 09 06:54:16 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258456, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.205.84@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
Aug 09 06:54:17 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258456, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.205.84@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
Aug 09 06:54:19 dist-test-slave-0b58 krb5kdc[22604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:54:19.674386 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44611
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:44611
--ranger_config_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.205.84:36113/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:54:20.084527 23068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:54:20.084976 23068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:54:20.085141 23068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:54:20.093238 23068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:54:20.093429 23068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:54:20.093549 23068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:54:20.093658 23068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:54:20.093746 23068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:54:20.105021 23068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.205.84:36113/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:44611
--ranger_config_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:54:20.106635 23068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:54:20.108127 23068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:54:20.121840 23075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:54:20.121840 23077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:54:20.122138 23074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:54:20.123183 23068 server_base.cc:1034] running on GCE node
I20260809 06:54:20.124001 23068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:54:20.125651 23068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:54:20.126924 23068 hybrid_clock.cc:648] HybridClock initialized: now 1786258460126863 us; error 46 us; skew 500 ppm
I20260809 06:54:20.127411 23068 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:54:20 dist-test-slave-0b58 krb5kdc[22604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258460, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:54:20.135761 23068 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:54:20.137555 23068 webserver.cc:460] Webserver started at http://127.10.205.126:45489/ using document root <none> and password file <none>
I20260809 06:54:20.138300 23068 fs_manager.cc:359] Metadata directory not provided
I20260809 06:54:20.138509 23068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:54:20.138873 23068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:54:20 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258460, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:54:20.196612 23068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "b0754cffa4e0498e9a98d41f1856e6c7"
format_stamp: "Formatted at 2026-08-09 06:54:20 on dist-test-slave-0b58"
server_key: "f378d573ccfed94291fd9065eea84e9d"
server_key_iv: "cf1fd6d4d26eef0d111bca64609fd48b"
server_key_version: "kuduclusterkey@0"
I20260809 06:54:20.197566 23068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "b0754cffa4e0498e9a98d41f1856e6c7"
format_stamp: "Formatted at 2026-08-09 06:54:20 on dist-test-slave-0b58"
server_key: "f378d573ccfed94291fd9065eea84e9d"
server_key_iv: "cf1fd6d4d26eef0d111bca64609fd48b"
server_key_version: "kuduclusterkey@0"
I20260809 06:54:20.203493 23068 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 06:54:20.220665 23084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:54:20.222589 23068 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 06:54:20.222843 23068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "b0754cffa4e0498e9a98d41f1856e6c7"
format_stamp: "Formatted at 2026-08-09 06:54:20 on dist-test-slave-0b58"
server_key: "f378d573ccfed94291fd9065eea84e9d"
server_key_iv: "cf1fd6d4d26eef0d111bca64609fd48b"
server_key_version: "kuduclusterkey@0"
I20260809 06:54:20.223116 23068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:54:20.239568 23068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:54:20.244057 23068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:54:20.244474 23068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:54:20.266217 23068 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:44611
I20260809 06:54:20.266237 23139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:44611 every 8 connection(s)
I20260809 06:54:20.267794 23068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:54:20.270483 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 23068
I20260809 06:54:20.270717 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:54:20.271559 11061 external_mini_cluster.cc:1428] Setting key d952ff59e6d4f368bbd7ba4fc48264b7
I20260809 06:54:20.272579 23140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 06:54:20 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:54:20.287819 23140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7: Bootstrap starting.
I20260809 06:54:20.291358 23140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7: Neither blocks nor log segments found. Creating new log.
I20260809 06:54:20.292584 23140 log.cc:824] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7: Log is configured to *not* fsync() on all Append() calls
I20260809 06:54:20.295644 23140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7: No bootstrap required, opened a new log
I20260809 06:54:20.296873 23144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:20.273779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48390 (local address 127.10.205.126:44611)
0809 06:54:20.274732 (+ 953us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:20.274744 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:20.274786 (+ 42us) server_negotiation.cc:407] Connection header received
0809 06:54:20.277530 (+ 2744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:20.277553 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:20.277986 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:20.278335 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:54:20.280004 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:20.281445 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:20.283260 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:20.283984 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:20.284134 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:20.289059 (+ 4925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:54:20.289067 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:54:20.289082 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:54:20.289121 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:54:20.292533 (+ 3412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:20.293275 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:20.293289 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:20.293295 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:20.293483 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:20.293904 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:20.293910 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:20.293913 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:20.294456 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:54:20.294796 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:20.295282 (+ 486us) server_negotiation.cc:299] Negotiation successful
0809 06:54:20.295680 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":740,"thread_start_us":526,"threads_started":1}
I20260809 06:54:20.304196 23140 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0754cffa4e0498e9a98d41f1856e6c7" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44611 } }
I20260809 06:54:20.304694 23140 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:54:20.304829 23140 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0754cffa4e0498e9a98d41f1856e6c7, State: Initialized, Role: FOLLOWER
I20260809 06:54:20.305402 23140 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0754cffa4e0498e9a98d41f1856e6c7" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44611 } }
I20260809 06:54:20.305665 23140 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:54:20.305830 23140 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:54:20.306075 23140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:54:20.308495 23140 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0754cffa4e0498e9a98d41f1856e6c7" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44611 } }
I20260809 06:54:20.309027 23140 leader_election.cc:302] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0754cffa4e0498e9a98d41f1856e6c7; no voters:
I20260809 06:54:20.309669 23140 leader_election.cc:288] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:54:20.309801 23146 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:54:20.310612 23146 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [term 1 LEADER]: Becoming Leader. State: Replica: b0754cffa4e0498e9a98d41f1856e6c7, State: Running, Role: LEADER
I20260809 06:54:20.311436 23146 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0754cffa4e0498e9a98d41f1856e6c7" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44611 } }
I20260809 06:54:20.312814 23140 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:54:20.314741 23148 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0754cffa4e0498e9a98d41f1856e6c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0754cffa4e0498e9a98d41f1856e6c7" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44611 } } }
I20260809 06:54:20.315205 23148 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:54:20.314625 23147 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0754cffa4e0498e9a98d41f1856e6c7. Latest consensus state: current_term: 1 leader_uuid: "b0754cffa4e0498e9a98d41f1856e6c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0754cffa4e0498e9a98d41f1856e6c7" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44611 } } }
I20260809 06:54:20.316828 23147 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:54:20.317389 23151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:54:20.322957 23151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:54:20.325706 23140 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 06:54:20.345009 23151 catalog_manager.cc:1347] Generated new cluster ID: 9d9bebf6c00b43479626f535bf408ed8
I20260809 06:54:20.345227 23151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:54:20.373289 23151 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:54:20.374830 23151 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:54:20.388196 23151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7: Generated new TSK 0
I20260809 06:54:20.389410 23151 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:54:21.178435 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.205.84:36113/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44611
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:54:21 dist-test-slave-0b58 krb5kdc[22604](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786258461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 06:54:21.614141 23186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:54:21.614610 23186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:54:21.614804 23186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:54:21.624920 23186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:54:21.625073 23186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:54:21.625270 23186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:54:21.636042 23186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.205.84:36113/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:54:21.637471 23186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:54:21.639043 23186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:54:21.659328 23196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:54:21.662048 23197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:54:21.667654 23199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:54:21.667934 23186 server_base.cc:1034] running on GCE node
I20260809 06:54:21.668952 23186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:54:21.670385 23186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:54:21.671752 23186 hybrid_clock.cc:648] HybridClock initialized: now 1786258461671628 us; error 113 us; skew 500 ppm
I20260809 06:54:21.672209 23186 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:54:21 dist-test-slave-0b58 krb5kdc[22604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:54:21.677068 23186 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:54:21.679332 23186 webserver.cc:460] Webserver started at http://127.10.205.65:33239/ using document root <none> and password file <none>
I20260809 06:54:21.680373 23186 fs_manager.cc:359] Metadata directory not provided
I20260809 06:54:21.680526 23186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:54:21.680917 23186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:54:21 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:54:21.708179 23186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "59e911a9ea044b2f8754c40d914f1308"
format_stamp: "Formatted at 2026-08-09 06:54:21 on dist-test-slave-0b58"
server_key: "2b30d3f9d2094ce39f1869167ef9eb53"
server_key_iv: "023857473909b38ef6f7a645d61db32c"
server_key_version: "kuduclusterkey@0"
I20260809 06:54:21.714859 23186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "59e911a9ea044b2f8754c40d914f1308"
format_stamp: "Formatted at 2026-08-09 06:54:21 on dist-test-slave-0b58"
server_key: "2b30d3f9d2094ce39f1869167ef9eb53"
server_key_iv: "023857473909b38ef6f7a645d61db32c"
server_key_version: "kuduclusterkey@0"
I20260809 06:54:21.726542 23186 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.005s sys 0.003s
I20260809 06:54:21.752517 23206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:54:21.754563 23186 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260809 06:54:21.754838 23186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "59e911a9ea044b2f8754c40d914f1308"
format_stamp: "Formatted at 2026-08-09 06:54:21 on dist-test-slave-0b58"
server_key: "2b30d3f9d2094ce39f1869167ef9eb53"
server_key_iv: "023857473909b38ef6f7a645d61db32c"
server_key_version: "kuduclusterkey@0"
I20260809 06:54:21.755261 23186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:54:21.788638 23186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:54:21.793010 23186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:54:21.793372 23186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:54:21.794416 23186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:54:21.795977 23186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:54:21.796089 23186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:54:21.796285 23186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:54:21.796376 23186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260809 06:54:21.885996 23186 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:37529
I20260809 06:54:21.886047 23325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:37529 every 8 connection(s)
I20260809 06:54:21.887880 23186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:54:21.890564 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 23186
I20260809 06:54:21.890812 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:54:21.891898 11061 external_mini_cluster.cc:1428] Setting key 011af9d3f82366c9b532433c54d3c179
Aug 09 06:54:21 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
I20260809 06:54:21.953840 23329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:21.909724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44611 (local address 127.10.205.65:36573)
0809 06:54:21.910737 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0809 06:54:21.910809 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 06:54:21.914854 (+ 4045us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:54:21.925507 (+ 10653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:54:21.925523 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:54:21.926261 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:54:21.927141 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:21.927166 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:21.928838 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:21.928843 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:21.930927 (+ 2084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:21.930951 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:21.932157 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:21.932163 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:21.932459 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:21.933350 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:54:21.933385 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:54:21.936166 (+ 2781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:54:21.940894 (+ 4728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:54:21.940904 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:54:21.940923 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:54:21.941487 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:54:21.949619 (+ 8132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:54:21.949627 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:54:21.949633 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:54:21.949998 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:54:21.950801 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:54:21.950810 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:54:21.951301 (+ 491us) client_negotiation.cc:769] Sending connection context
0809 06:54:21.951642 (+ 341us) client_negotiation.cc:240] Negotiation successful
0809 06:54:21.952249 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":756,"threads_started":1}
I20260809 06:54:21.955443 23330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:21.910431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:36573 (local address 127.10.205.126:44611)
0809 06:54:21.924727 (+ 14296us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:21.924733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:21.924762 (+ 29us) server_negotiation.cc:407] Connection header received
0809 06:54:21.924838 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:21.924843 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:21.924950 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:21.925097 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:54:21.927435 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:21.928630 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:21.931146 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:21.931727 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:21.931818 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:21.936446 (+ 4628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:54:21.936453 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:54:21.936458 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:54:21.936504 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:54:21.940403 (+ 3899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:21.949180 (+ 8777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:21.949188 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:21.949192 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:21.949419 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:21.950164 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:21.950169 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:21.950173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:21.950557 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:54:21.950708 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:21.954609 (+ 3901us) server_negotiation.cc:299] Negotiation successful
0809 06:54:21.954946 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14144,"thread_start_us":14017,"threads_started":1}
I20260809 06:54:21.957571 23326 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44611
I20260809 06:54:21.957945 23326 heartbeater.cc:464] Registering TS with master...
I20260809 06:54:21.958923 23326 heartbeater.cc:511] Master 127.10.205.126:44611 requested a full tablet report, sending...
I20260809 06:54:21.961668 23102 ts_manager.cc:194] Registered new tserver with Master: 59e911a9ea044b2f8754c40d914f1308 (127.10.205.65:37529)
I20260809 06:54:21.963804 23102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:36573
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:54:21.983825 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.205.84:36113/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44611
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:54:22 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
Aug 09 06:54:22 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258461, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
W20260809 06:54:22.511435 23332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:54:22.512012 23332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:54:22.512238 23332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:54:22.524067 23332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:54:22.524323 23332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:54:22.524576 23332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:54:22.541476 23332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.205.84:36113/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:54:22.543435 23332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:54:22.545287 23332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:54:22.563354 23340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:54:22.564464 23341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:54:22.573262 23343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:54:22.574244 23332 server_base.cc:1034] running on GCE node
I20260809 06:54:22.575301 23332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:54:22.580235 23332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:54:22.581609 23332 hybrid_clock.cc:648] HybridClock initialized: now 1786258462581531 us; error 71 us; skew 500 ppm
I20260809 06:54:22.582093 23332 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:54:22 dist-test-slave-0b58 krb5kdc[22604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258462, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:54:22.586771 23332 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:54:22.588948 23332 webserver.cc:460] Webserver started at http://127.10.205.66:41911/ using document root <none> and password file <none>
I20260809 06:54:22.590014 23332 fs_manager.cc:359] Metadata directory not provided
I20260809 06:54:22.590175 23332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:54:22.590627 23332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:54:22 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258462, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:54:22.610158 23332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "ada00bcf69004917aaea2202a9efdf5c"
format_stamp: "Formatted at 2026-08-09 06:54:22 on dist-test-slave-0b58"
server_key: "a41549d0ca83d85ef5523baa2f856963"
server_key_iv: "a55222151d76d10bb3129e8f25fff8d4"
server_key_version: "kuduclusterkey@0"
I20260809 06:54:22.611296 23332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "ada00bcf69004917aaea2202a9efdf5c"
format_stamp: "Formatted at 2026-08-09 06:54:22 on dist-test-slave-0b58"
server_key: "a41549d0ca83d85ef5523baa2f856963"
server_key_iv: "a55222151d76d10bb3129e8f25fff8d4"
server_key_version: "kuduclusterkey@0"
I20260809 06:54:22.617606 23332 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260809 06:54:22.637679 23357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:54:22.639767 23332 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:54:22.640058 23332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "ada00bcf69004917aaea2202a9efdf5c"
format_stamp: "Formatted at 2026-08-09 06:54:22 on dist-test-slave-0b58"
server_key: "a41549d0ca83d85ef5523baa2f856963"
server_key_iv: "a55222151d76d10bb3129e8f25fff8d4"
server_key_version: "kuduclusterkey@0"
I20260809 06:54:22.640483 23332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:54:22.662518 23332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:54:22.668455 23332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:54:22.668910 23332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:54:22.670260 23332 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:54:22.672210 23332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:54:22.672389 23332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 06:54:22.672561 23332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:54:22.672662 23332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:54:22.719764 23332 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:32881
I20260809 06:54:22.719851 23472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:32881 every 8 connection(s)
I20260809 06:54:22.721573 23332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:54:22.726881 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 23332
I20260809 06:54:22.727087 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:54:22.727716 11061 external_mini_cluster.cc:1428] Setting key 8e3f63fae0a9f274df78118005af4349
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Aug 09 06:54:22 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258462, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:54:22.786437 23476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:22.725824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:42161 (local address 127.10.205.126:44611)
0809 06:54:22.751316 (+ 25492us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:22.751326 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:22.752584 (+ 1258us) server_negotiation.cc:407] Connection header received
0809 06:54:22.756813 (+ 4229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:22.756822 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:22.756933 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:22.757026 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:54:22.760280 (+ 3254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:22.761783 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:22.765008 (+ 3225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:22.765818 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:22.765938 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:22.777729 (+ 11791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:54:22.777736 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:54:22.777739 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:54:22.777784 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:54:22.781758 (+ 3974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:22.782956 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:22.782964 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:22.782970 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:22.783136 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:22.783725 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:22.783733 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:22.783739 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:22.784173 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:54:22.784369 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:22.785585 (+ 1216us) server_negotiation.cc:299] Negotiation successful
0809 06:54:22.785903 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25296,"thread_start_us":25520,"threads_started":1}
I20260809 06:54:22.788632 23475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:22.725186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44611 (local address 127.10.205.66:42161)
0809 06:54:22.752170 (+ 26984us) negotiation.cc:107] Waiting for socket to connect
0809 06:54:22.752274 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0809 06:54:22.755474 (+ 3200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:54:22.757620 (+ 2146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:54:22.757636 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:54:22.758719 (+ 1083us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:54:22.759967 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:22.760006 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:22.762057 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:22.762065 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:22.764775 (+ 2710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:22.764799 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:22.766382 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:22.766392 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:22.766753 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:22.767682 (+ 929us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:54:22.767723 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:54:22.777366 (+ 9643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:54:22.782000 (+ 4634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:54:22.782013 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:54:22.782038 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:54:22.782785 (+ 747us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:54:22.783295 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:54:22.783301 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:54:22.783308 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:54:22.783576 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:54:22.784479 (+ 903us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:54:22.784490 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:54:22.785066 (+ 576us) client_negotiation.cc:769] Sending connection context
0809 06:54:22.786394 (+ 1328us) client_negotiation.cc:240] Negotiation successful
0809 06:54:22.787016 (+ 622us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26575,"thread_start_us":30530,"threads_started":1}
I20260809 06:54:22.790719 23473 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44611
I20260809 06:54:22.791056 23473 heartbeater.cc:464] Registering TS with master...
I20260809 06:54:22.791980 23473 heartbeater.cc:511] Master 127.10.205.126:44611 requested a full tablet report, sending...
I20260809 06:54:22.793817 23102 ts_manager.cc:194] Registered new tserver with Master: ada00bcf69004917aaea2202a9efdf5c (127.10.205.66:32881)
I20260809 06:54:22.795176 23102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:42161
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:54:22.815428 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.205.84:36113/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44611
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:54:22.968199 23326 heartbeater.cc:503] Master 127.10.205.126:44611 was elected leader, sending a full tablet report...
W20260809 06:54:23.414723 23479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:54:23.415148 23479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:54:23.415419 23479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:54:23.426751 23479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:54:23.426999 23479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:54:23.427284 23479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:54:23.441625 23479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.205.84:36113/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:54:23.443089 23479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:54:23.444676 23479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:54:23.464010 23486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:54:23.464150 23485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:54:23.463889 23488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:54:23.469112 23479 server_base.cc:1034] running on GCE node
I20260809 06:54:23.469821 23479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:54:23.470909 23479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:54:23.472177 23479 hybrid_clock.cc:648] HybridClock initialized: now 1786258463472109 us; error 60 us; skew 500 ppm
I20260809 06:54:23.472654 23479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:54:23 dist-test-slave-0b58 krb5kdc[22604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258463, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:54:23.477421 23479 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:54:23.480504 23479 webserver.cc:460] Webserver started at http://127.10.205.67:34401/ using document root <none> and password file <none>
I20260809 06:54:23.481699 23479 fs_manager.cc:359] Metadata directory not provided
I20260809 06:54:23.481909 23479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:54:23.482468 23479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:54:23 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258463, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:54:23.497851 23479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "fda2d351bf8e4a649c2ac29f97b39697"
format_stamp: "Formatted at 2026-08-09 06:54:23 on dist-test-slave-0b58"
server_key: "6134fadb398972c57e02b22ae90053ce"
server_key_iv: "cffe63447011a4a074afa4998a0bf5f8"
server_key_version: "kuduclusterkey@0"
I20260809 06:54:23.498854 23479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "fda2d351bf8e4a649c2ac29f97b39697"
format_stamp: "Formatted at 2026-08-09 06:54:23 on dist-test-slave-0b58"
server_key: "6134fadb398972c57e02b22ae90053ce"
server_key_iv: "cffe63447011a4a074afa4998a0bf5f8"
server_key_version: "kuduclusterkey@0"
I20260809 06:54:23.505367 23479 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 06:54:23.525563 23495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:54:23.527274 23479 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:54:23.527525 23479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "fda2d351bf8e4a649c2ac29f97b39697"
format_stamp: "Formatted at 2026-08-09 06:54:23 on dist-test-slave-0b58"
server_key: "6134fadb398972c57e02b22ae90053ce"
server_key_iv: "cffe63447011a4a074afa4998a0bf5f8"
server_key_version: "kuduclusterkey@0"
I20260809 06:54:23.527860 23479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:54:23.551200 23479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:54:23.555675 23479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:54:23.556123 23479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:54:23.557483 23479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:54:23.559449 23479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:54:23.559540 23479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:54:23.559669 23479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:54:23.559732 23479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:54:23.619489 23479 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:34727
I20260809 06:54:23.619524 23613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:34727 every 8 connection(s)
I20260809 06:54:23.621053 23479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:54:23.627746 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 23479
I20260809 06:54:23.627974 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:54:23.628674 11061 external_mini_cluster.cc:1428] Setting key 4b1ed0f113a358ef54289800c32a79e4
Aug 09 06:54:23 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258463, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:54:23.646193 23616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.624098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:52231 (local address 127.10.205.126:44611)
0809 06:54:23.624763 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:23.624768 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:23.625974 (+ 1206us) server_negotiation.cc:407] Connection header received
0809 06:54:23.628543 (+ 2569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:23.628551 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:23.628669 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:23.628827 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:54:23.630959 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.631874 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.634295 (+ 2421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.634885 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.634991 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.639098 (+ 4107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:54:23.639103 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:54:23.639106 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:54:23.639141 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:54:23.642609 (+ 3468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:23.643551 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:23.643557 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:23.643560 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:23.643763 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:23.644308 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:23.644313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:23.644317 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:23.644695 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:54:23.644917 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:23.645660 (+ 743us) server_negotiation.cc:299] Negotiation successful
0809 06:54:23.645872 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":374,"threads_started":1}
I20260809 06:54:23.647500 23617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.624863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44611 (local address 127.10.205.67:52231)
0809 06:54:23.625807 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0809 06:54:23.625849 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:54:23.628175 (+ 2326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:54:23.629335 (+ 1160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:54:23.629344 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:54:23.629868 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:54:23.630775 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:23.630803 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.632214 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.632222 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:23.634113 (+ 1891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:23.634142 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.635127 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.635132 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:23.635402 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.636209 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:54:23.636234 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:54:23.638821 (+ 2587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:54:23.642871 (+ 4050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:54:23.642879 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:54:23.642893 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:54:23.643444 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:54:23.643883 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:54:23.643886 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:54:23.643889 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:54:23.644169 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:54:23.644865 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:54:23.644877 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:54:23.645315 (+ 438us) client_negotiation.cc:769] Sending connection context
0809 06:54:23.645552 (+ 237us) client_negotiation.cc:240] Negotiation successful
0809 06:54:23.646154 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":438,"threads_started":1}
I20260809 06:54:23.649214 23614 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44611
I20260809 06:54:23.649582 23614 heartbeater.cc:464] Registering TS with master...
I20260809 06:54:23.650719 23614 heartbeater.cc:511] Master 127.10.205.126:44611 requested a full tablet report, sending...
I20260809 06:54:23.652477 23102 ts_manager.cc:194] Registered new tserver with Master: fda2d351bf8e4a649c2ac29f97b39697 (127.10.205.67:34727)
I20260809 06:54:23.653609 23102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:52231
I20260809 06:54:23.657884 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:54:23.678522 23616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.663319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49376 (local address 127.10.205.126:44611)
0809 06:54:23.663520 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:23.663527 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:23.664125 (+ 598us) server_negotiation.cc:407] Connection header received
0809 06:54:23.664450 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:23.664456 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:23.664559 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:23.664670 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:54:23.666511 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.667359 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.668957 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.669497 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.669653 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.672385 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:54:23.672391 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:54:23.672394 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:54:23.672429 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:54:23.675464 (+ 3035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:23.676196 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:23.676204 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:23.676208 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:23.676436 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:23.676889 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:23.676895 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:23.676898 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:23.677218 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:54:23.677526 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:23.677889 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 06:54:23.678159 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:54:23.683032 23102 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49376:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:54:23.692341 23102 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:54:23.729847 23627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.707761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:34727 (local address 127.0.0.1:50366)
0809 06:54:23.709216 (+ 1455us) negotiation.cc:107] Waiting for socket to connect
0809 06:54:23.709269 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 06:54:23.709510 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:54:23.711683 (+ 2173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:54:23.711695 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:54:23.711741 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:54:23.712606 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:23.712626 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.715811 (+ 3185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.715820 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:23.723157 (+ 7337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:23.723297 (+ 140us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.727457 (+ 4160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.727466 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:23.728928 (+ 1462us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.728995 (+ 67us) client_negotiation.cc:769] Sending connection context
0809 06:54:23.729123 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 06:54:23.729385 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1096,"thread_start_us":807,"threads_started":1}
I20260809 06:54:23.730222 23628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.707899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50366 (local address 127.10.205.67:34727)
0809 06:54:23.710262 (+ 2363us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:23.710274 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:23.710335 (+ 61us) server_negotiation.cc:407] Connection header received
0809 06:54:23.710461 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:23.710472 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:23.710836 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:23.711108 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:54:23.712957 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.715558 (+ 2601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.723469 (+ 7911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.726781 (+ 3312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.726923 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.727205 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:23.729567 (+ 2362us) server_negotiation.cc:299] Negotiation successful
0809 06:54:23.729791 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2159,"thread_start_us":1911,"threads_started":1}
I20260809 06:54:23.732993 23629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.710156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:37529 (local address 127.0.0.1:50146)
0809 06:54:23.718662 (+ 8506us) negotiation.cc:107] Waiting for socket to connect
0809 06:54:23.718686 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:54:23.718839 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:54:23.721709 (+ 2870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:54:23.721718 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:54:23.721754 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:54:23.722458 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:23.722476 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.726324 (+ 3848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.726333 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:23.729467 (+ 3134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:23.729485 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.731898 (+ 2413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.731906 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:23.732119 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.732155 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:54:23.732302 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 06:54:23.732537 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8312,"thread_start_us":8009,"threads_started":1}
I20260809 06:54:23.733024 23630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.710150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50146 (local address 127.10.205.65:37529)
0809 06:54:23.719685 (+ 9535us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:23.719698 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:23.719738 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:54:23.719862 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:23.719875 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:23.721411 (+ 1536us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:23.722721 (+ 1310us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:54:23.723135 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.726098 (+ 2963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.729680 (+ 3582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.731644 (+ 1964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.731803 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.732136 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:23.732344 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 06:54:23.732577 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9255,"thread_start_us":14779,"threads_started":1}
I20260809 06:54:23.734776 23544 tablet_service.cc:1467] Processing CreateTablet for tablet c06935dc322c4cfda79ba3ce9187486e (DEFAULT_TABLE table=test-table [id=0c3c13b1400140c59c557de8196c9291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:54:23.736593 23544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c06935dc322c4cfda79ba3ce9187486e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:54:23.737152 23258 tablet_service.cc:1467] Processing CreateTablet for tablet c06935dc322c4cfda79ba3ce9187486e (DEFAULT_TABLE table=test-table [id=0c3c13b1400140c59c557de8196c9291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:54:23.738835 23258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c06935dc322c4cfda79ba3ce9187486e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:54:23.739802 23631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.718623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:32881 (local address 127.0.0.1:37212)
0809 06:54:23.721096 (+ 2473us) negotiation.cc:107] Waiting for socket to connect
0809 06:54:23.721120 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:54:23.721275 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:54:23.730245 (+ 8970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:54:23.730250 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:54:23.730277 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:54:23.730914 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:23.730930 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.734026 (+ 3096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.734031 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:23.736481 (+ 2450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:23.736496 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.738893 (+ 2397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.738902 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:23.739114 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.739146 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:54:23.739243 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 06:54:23.739393 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2278,"thread_start_us":2075,"threads_started":1}
I20260809 06:54:23.739928 23632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.718933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37212 (local address 127.10.205.66:32881)
0809 06:54:23.729593 (+ 10660us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:23.729602 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:23.729632 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:54:23.729721 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:23.729728 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:23.729995 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:23.731154 (+ 1159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:54:23.731472 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.733720 (+ 2248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.736661 (+ 2941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.738274 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.738419 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.738663 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:23.739307 (+ 644us) server_negotiation.cc:299] Negotiation successful
0809 06:54:23.739488 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10469,"thread_start_us":10315,"threads_started":1}
I20260809 06:54:23.743994 23407 tablet_service.cc:1467] Processing CreateTablet for tablet c06935dc322c4cfda79ba3ce9187486e (DEFAULT_TABLE table=test-table [id=0c3c13b1400140c59c557de8196c9291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:54:23.745716 23407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c06935dc322c4cfda79ba3ce9187486e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:54:23.750780 23633 tablet_bootstrap.cc:492] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697: Bootstrap starting.
I20260809 06:54:23.755853 23633 tablet_bootstrap.cc:654] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697: Neither blocks nor log segments found. Creating new log.
I20260809 06:54:23.757452 23633 log.cc:824] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697: Log is configured to *not* fsync() on all Append() calls
I20260809 06:54:23.758656 23634 tablet_bootstrap.cc:492] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308: Bootstrap starting.
I20260809 06:54:23.763370 23636 tablet_bootstrap.cc:492] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c: Bootstrap starting.
I20260809 06:54:23.764235 23633 tablet_bootstrap.cc:492] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697: No bootstrap required, opened a new log
I20260809 06:54:23.764277 23634 tablet_bootstrap.cc:654] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308: Neither blocks nor log segments found. Creating new log.
I20260809 06:54:23.764616 23633 ts_tablet_manager.cc:1397] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.006s
I20260809 06:54:23.766973 23634 log.cc:824] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308: Log is configured to *not* fsync() on all Append() calls
I20260809 06:54:23.767876 23636 tablet_bootstrap.cc:654] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c: Neither blocks nor log segments found. Creating new log.
I20260809 06:54:23.769757 23636 log.cc:824] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c: Log is configured to *not* fsync() on all Append() calls
I20260809 06:54:23.771440 23634 tablet_bootstrap.cc:492] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308: No bootstrap required, opened a new log
I20260809 06:54:23.771802 23634 ts_tablet_manager.cc:1397] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20260809 06:54:23.773939 23636 tablet_bootstrap.cc:492] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c: No bootstrap required, opened a new log
I20260809 06:54:23.774257 23636 ts_tablet_manager.cc:1397] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260809 06:54:23.779191 23633 raft_consensus.cc:348] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fda2d351bf8e4a649c2ac29f97b39697" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34727 } } peers { permanent_uuid: "59e911a9ea044b2f8754c40d914f1308" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 37529 } } peers { permanent_uuid: "ada00bcf69004917aaea2202a9efdf5c" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 32881 } }
I20260809 06:54:23.779767 23633 raft_consensus.cc:374] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:54:23.779901 23633 raft_consensus.cc:729] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda2d351bf8e4a649c2ac29f97b39697, State: Initialized, Role: FOLLOWER
I20260809 06:54:23.780668 23633 consensus_queue.cc:260] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fda2d351bf8e4a649c2ac29f97b39697" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34727 } } peers { permanent_uuid: "59e911a9ea044b2f8754c40d914f1308" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 37529 } } peers { permanent_uuid: "ada00bcf69004917aaea2202a9efdf5c" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 32881 } }
I20260809 06:54:23.782171 23614 heartbeater.cc:503] Master 127.10.205.126:44611 was elected leader, sending a full tablet report...
I20260809 06:54:23.783197 23636 raft_consensus.cc:348] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fda2d351bf8e4a649c2ac29f97b39697" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34727 } } peers { permanent_uuid: "59e911a9ea044b2f8754c40d914f1308" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 37529 } } peers { permanent_uuid: "ada00bcf69004917aaea2202a9efdf5c" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 32881 } }
I20260809 06:54:23.783695 23636 raft_consensus.cc:374] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:54:23.783833 23636 raft_consensus.cc:729] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ada00bcf69004917aaea2202a9efdf5c, State: Initialized, Role: FOLLOWER
I20260809 06:54:23.784767 23633 ts_tablet_manager.cc:1428] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697: Time spent starting tablet: real 0.020s user 0.009s sys 0.009s
I20260809 06:54:23.784667 23636 consensus_queue.cc:260] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fda2d351bf8e4a649c2ac29f97b39697" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34727 } } peers { permanent_uuid: "59e911a9ea044b2f8754c40d914f1308" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 37529 } } peers { permanent_uuid: "ada00bcf69004917aaea2202a9efdf5c" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 32881 } }
I20260809 06:54:23.785560 23634 raft_consensus.cc:348] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fda2d351bf8e4a649c2ac29f97b39697" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34727 } } peers { permanent_uuid: "59e911a9ea044b2f8754c40d914f1308" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 37529 } } peers { permanent_uuid: "ada00bcf69004917aaea2202a9efdf5c" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 32881 } }
I20260809 06:54:23.786166 23634 raft_consensus.cc:374] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:54:23.786330 23634 raft_consensus.cc:729] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59e911a9ea044b2f8754c40d914f1308, State: Initialized, Role: FOLLOWER
I20260809 06:54:23.787492 23473 heartbeater.cc:503] Master 127.10.205.126:44611 was elected leader, sending a full tablet report...
I20260809 06:54:23.788048 23634 consensus_queue.cc:260] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fda2d351bf8e4a649c2ac29f97b39697" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34727 } } peers { permanent_uuid: "59e911a9ea044b2f8754c40d914f1308" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 37529 } } peers { permanent_uuid: "ada00bcf69004917aaea2202a9efdf5c" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 32881 } }
I20260809 06:54:23.788525 23636 ts_tablet_manager.cc:1428] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
I20260809 06:54:23.790570 23634 ts_tablet_manager.cc:1428] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308: Time spent starting tablet: real 0.019s user 0.019s sys 0.000s
W20260809 06:54:23.873514 23615 tablet.cc:2369] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:54:23.902815 23327 tablet.cc:2369] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:54:23.950388 23640 raft_consensus.cc:482] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:54:23.950814 23640 raft_consensus.cc:504] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fda2d351bf8e4a649c2ac29f97b39697" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34727 } } peers { permanent_uuid: "59e911a9ea044b2f8754c40d914f1308" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 37529 } } peers { permanent_uuid: "ada00bcf69004917aaea2202a9efdf5c" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 32881 } }
I20260809 06:54:23.952812 23640 leader_election.cc:288] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fda2d351bf8e4a649c2ac29f97b39697 (127.10.205.67:34727), 59e911a9ea044b2f8754c40d914f1308 (127.10.205.65:37529)
I20260809 06:54:23.962216 23628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.953281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:48663 (local address 127.10.205.67:34727)
0809 06:54:23.953558 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:23.953566 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:23.954445 (+ 879us) server_negotiation.cc:407] Connection header received
0809 06:54:23.954768 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:23.954778 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:23.954902 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:23.955023 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:54:23.956080 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.956983 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.959406 (+ 2423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.960854 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.961038 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.961118 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:23.961695 (+ 577us) server_negotiation.cc:299] Negotiation successful
0809 06:54:23.961835 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 06:54:23.962277 23642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.953440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:34727 (local address 127.10.205.66:48663)
0809 06:54:23.954318 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0809 06:54:23.954335 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:54:23.954564 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:54:23.955234 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:54:23.955238 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:54:23.955264 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:54:23.955916 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:23.955926 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.957133 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.957140 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:23.959219 (+ 2079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:23.959235 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.961317 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.961324 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:23.961533 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.961567 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 06:54:23.961665 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 06:54:23.961836 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"thread_start_us":522,"threads_started":1}
I20260809 06:54:23.962656 23630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.954680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:50241 (local address 127.10.205.65:37529)
0809 06:54:23.954943 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:23.954951 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:23.955378 (+ 427us) server_negotiation.cc:407] Connection header received
0809 06:54:23.955596 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:23.955600 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:23.955657 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:23.955754 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:54:23.956593 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.957441 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.960177 (+ 2736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.961642 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.961855 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.961938 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:23.962232 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 06:54:23.962372 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 06:54:23.963376 23643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:23.954480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:37529 (local address 127.10.205.66:50241)
0809 06:54:23.955270 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0809 06:54:23.955285 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:54:23.955456 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:54:23.955773 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:54:23.955777 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:54:23.955813 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:54:23.956425 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:23.956437 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.957604 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.957614 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:23.959984 (+ 2370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:54:23.959997 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:54:23.961911 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:54:23.961918 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:54:23.962074 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:23.962096 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 06:54:23.962205 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 06:54:23.962793 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"mutex_wait_us":4,"thread_start_us":501,"threads_started":1}
I20260809 06:54:23.963600 23565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c06935dc322c4cfda79ba3ce9187486e" candidate_uuid: "ada00bcf69004917aaea2202a9efdf5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda2d351bf8e4a649c2ac29f97b39697" is_pre_election: true
I20260809 06:54:23.964228 23565 raft_consensus.cc:2454] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ada00bcf69004917aaea2202a9efdf5c in term 0.
I20260809 06:54:23.964494 23279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c06935dc322c4cfda79ba3ce9187486e" candidate_uuid: "ada00bcf69004917aaea2202a9efdf5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59e911a9ea044b2f8754c40d914f1308" is_pre_election: true
I20260809 06:54:23.965165 23279 raft_consensus.cc:2454] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ada00bcf69004917aaea2202a9efdf5c in term 0.
I20260809 06:54:23.965209 23361 leader_election.cc:302] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ada00bcf69004917aaea2202a9efdf5c, fda2d351bf8e4a649c2ac29f97b39697; no voters:
I20260809 06:54:23.966032 23640 raft_consensus.cc:2781] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:54:23.966264 23640 raft_consensus.cc:482] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:54:23.966410 23640 raft_consensus.cc:3037] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:54:23.969122 23640 raft_consensus.cc:504] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fda2d351bf8e4a649c2ac29f97b39697" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34727 } } peers { permanent_uuid: "59e911a9ea044b2f8754c40d914f1308" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 37529 } } peers { permanent_uuid: "ada00bcf69004917aaea2202a9efdf5c" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 32881 } }
I20260809 06:54:23.969872 23640 leader_election.cc:288] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [CANDIDATE]: Term 1 election: Requested vote from peers fda2d351bf8e4a649c2ac29f97b39697 (127.10.205.67:34727), 59e911a9ea044b2f8754c40d914f1308 (127.10.205.65:37529)
I20260809 06:54:23.970351 23565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c06935dc322c4cfda79ba3ce9187486e" candidate_uuid: "ada00bcf69004917aaea2202a9efdf5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fda2d351bf8e4a649c2ac29f97b39697"
I20260809 06:54:23.970412 23279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c06935dc322c4cfda79ba3ce9187486e" candidate_uuid: "ada00bcf69004917aaea2202a9efdf5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59e911a9ea044b2f8754c40d914f1308"
I20260809 06:54:23.970606 23565 raft_consensus.cc:3037] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:54:23.970638 23279 raft_consensus.cc:3037] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:54:23.973595 23279 raft_consensus.cc:2454] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ada00bcf69004917aaea2202a9efdf5c in term 1.
I20260809 06:54:23.973587 23565 raft_consensus.cc:2454] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ada00bcf69004917aaea2202a9efdf5c in term 1.
I20260809 06:54:23.974115 23361 leader_election.cc:302] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ada00bcf69004917aaea2202a9efdf5c, fda2d351bf8e4a649c2ac29f97b39697; no voters:
I20260809 06:54:23.974498 23640 raft_consensus.cc:2781] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:54:23.975107 23640 raft_consensus.cc:686] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 1 LEADER]: Becoming Leader. State: Replica: ada00bcf69004917aaea2202a9efdf5c, State: Running, Role: LEADER
I20260809 06:54:23.975980 23640 consensus_queue.cc:237] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fda2d351bf8e4a649c2ac29f97b39697" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34727 } } peers { permanent_uuid: "59e911a9ea044b2f8754c40d914f1308" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 37529 } } peers { permanent_uuid: "ada00bcf69004917aaea2202a9efdf5c" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 32881 } }
I20260809 06:54:23.981223 23101 catalog_manager.cc:5495] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c reported cstate change: term changed from 0 to 1, leader changed from <none> to ada00bcf69004917aaea2202a9efdf5c (127.10.205.66). New cstate: current_term: 1 leader_uuid: "ada00bcf69004917aaea2202a9efdf5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fda2d351bf8e4a649c2ac29f97b39697" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59e911a9ea044b2f8754c40d914f1308" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 37529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ada00bcf69004917aaea2202a9efdf5c" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 32881 } health_report { overall_health: HEALTHY } } }
W20260809 06:54:23.984375 23474 tablet.cc:2369] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:54:24.033705 23632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:24.027152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37218 (local address 127.10.205.66:32881)
0809 06:54:24.027428 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:24.027434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:24.027571 (+ 137us) server_negotiation.cc:407] Connection header received
0809 06:54:24.027816 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:24.027820 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:24.027929 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:24.028096 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:54:24.028589 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:24.029441 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:24.031086 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:24.031548 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:24.031693 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:24.032387 (+ 694us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:54:24.033038 (+ 651us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:54:24.033207 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:24.033314 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 06:54:24.033399 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 06:54:24.042907 23565 raft_consensus.cc:1261] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697 [term 1 FOLLOWER]: Refusing update from remote peer ada00bcf69004917aaea2202a9efdf5c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:54:24.042927 23279 raft_consensus.cc:1261] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308 [term 1 FOLLOWER]: Refusing update from remote peer ada00bcf69004917aaea2202a9efdf5c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:54:24.043939 23640 consensus_queue.cc:1035] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fda2d351bf8e4a649c2ac29f97b39697" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:54:24.044356 23644 consensus_queue.cc:1035] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59e911a9ea044b2f8754c40d914f1308" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 37529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:54:24.080418 23102 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:54:24.080788 23102 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:54:24.085029 23102 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0754cffa4e0498e9a98d41f1856e6c7: Sending DeleteTablet for 3 replicas of tablet c06935dc322c4cfda79ba3ce9187486e
I20260809 06:54:24.086426 23544 tablet_service.cc:1514] Processing DeleteTablet for tablet c06935dc322c4cfda79ba3ce9187486e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:54:24 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:50366
I20260809 06:54:24.086565 23258 tablet_service.cc:1514] Processing DeleteTablet for tablet c06935dc322c4cfda79ba3ce9187486e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:54:24 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:50146
I20260809 06:54:24.086895 23407 tablet_service.cc:1514] Processing DeleteTablet for tablet c06935dc322c4cfda79ba3ce9187486e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:54:24 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:37212
I20260809 06:54:24.090652 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 23186
I20260809 06:54:24.117668 23659 tablet_replica.cc:330] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c: stopping tablet replica
I20260809 06:54:24.118510 23659 raft_consensus.cc:2229] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:54:24.119647 23659 raft_consensus.cc:2258] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:54:24.123881 23658 tablet_replica.cc:330] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308: stopping tablet replica
I20260809 06:54:24.124735 23657 tablet_replica.cc:330] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697: stopping tablet replica
I20260809 06:54:24.125458 23657 raft_consensus.cc:2229] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:54:24.125793 23658 raft_consensus.cc:2229] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:54:24.126058 23657 raft_consensus.cc:2258] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:54:24.126852 23659 ts_tablet_manager.cc:1905] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:54:24.126905 23658 raft_consensus.cc:2258] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:54:24.128602 23657 ts_tablet_manager.cc:1905] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:54:24.129609 23658 ts_tablet_manager.cc:1905] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:54:24.138371 23659 ts_tablet_manager.cc:1918] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:54:24.138382 23658 ts_tablet_manager.cc:1918] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:54:24.138635 23659 log.cc:1196] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/c06935dc322c4cfda79ba3ce9187486e
I20260809 06:54:24.138852 23658 log.cc:1196] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/c06935dc322c4cfda79ba3ce9187486e
I20260809 06:54:24.139358 23659 ts_tablet_manager.cc:1939] T c06935dc322c4cfda79ba3ce9187486e P ada00bcf69004917aaea2202a9efdf5c: Deleting consensus metadata
I20260809 06:54:24.139690 23658 ts_tablet_manager.cc:1939] T c06935dc322c4cfda79ba3ce9187486e P 59e911a9ea044b2f8754c40d914f1308: Deleting consensus metadata
Aug 09 06:54:24 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:54:24.141891 23087 catalog_manager.cc:4841] TS ada00bcf69004917aaea2202a9efdf5c (127.10.205.66:32881): tablet c06935dc322c4cfda79ba3ce9187486e (table test-table [id=0c3c13b1400140c59c557de8196c9291]) successfully deleted
I20260809 06:54:24.142302 23087 catalog_manager.cc:4841] TS 59e911a9ea044b2f8754c40d914f1308 (127.10.205.65:37529): tablet c06935dc322c4cfda79ba3ce9187486e (table test-table [id=0c3c13b1400140c59c557de8196c9291]) successfully deleted
I20260809 06:54:24.145098 23657 ts_tablet_manager.cc:1918] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:54:24.145392 23657 log.cc:1196] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/c06935dc322c4cfda79ba3ce9187486e
I20260809 06:54:24.146027 23657 ts_tablet_manager.cc:1939] T c06935dc322c4cfda79ba3ce9187486e P fda2d351bf8e4a649c2ac29f97b39697: Deleting consensus metadata
I20260809 06:54:24.148123 23087 catalog_manager.cc:4841] TS fda2d351bf8e4a649c2ac29f97b39697 (127.10.205.67:34727): tablet c06935dc322c4cfda79ba3ce9187486e (table test-table [id=0c3c13b1400140c59c557de8196c9291]) successfully deleted
I20260809 06:54:24.152523 23630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:24.092758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50156 (local address 127.10.205.65:37529)
0809 06:54:24.093010 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:24.093019 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:24.113629 (+ 20610us) server_negotiation.cc:407] Connection header received
0809 06:54:24.114057 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:24.114067 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:24.114221 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:24.114323 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:54:24.120165 (+ 5842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:24.121920 (+ 1755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:24.133914 (+ 11994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:24.134826 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:24.135005 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:24.143612 (+ 8607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:54:24.143630 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:54:24.143649 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:54:24.143717 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:54:24.148780 (+ 5063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:24.149677 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:24.149689 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:24.149693 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:24.149919 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:24.150380 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:24.150385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:24.150390 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:24.150981 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:54:24.151369 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:24.151697 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 06:54:24.151965 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 06:54:24.153569 23320 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:54:24.258912 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 23186
I20260809 06:54:24.281471 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 23332
Aug 09 06:54:24 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:54:24.299227 23632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:24.282312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37226 (local address 127.10.205.66:32881)
0809 06:54:24.282541 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:24.282548 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:24.282685 (+ 137us) server_negotiation.cc:407] Connection header received
0809 06:54:24.282899 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:24.282904 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:24.283005 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:24.283118 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:54:24.284696 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:24.285758 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:24.287137 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:24.287606 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:24.287761 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:24.292626 (+ 4865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:54:24.292644 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:54:24.292661 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:54:24.292705 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:54:24.295949 (+ 3244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:24.296828 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:24.296837 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:24.296839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:24.297011 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:24.297508 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:24.297513 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:24.297515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:24.297892 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:54:24.298216 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:24.298562 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 06:54:24.298844 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:54:24.300014 23468 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:54:24.418428 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 23332
I20260809 06:54:24.440739 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 23479
Aug 09 06:54:24 dist-test-slave-0b58 krb5kdc[22604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:54:24.456182 23628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:54:24.441588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50374 (local address 127.10.205.67:34727)
0809 06:54:24.441780 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 06:54:24.441785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:54:24.441805 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:54:24.441942 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:54:24.441946 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:54:24.442008 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:54:24.442093 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:54:24.443476 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:24.444241 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:24.445608 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:54:24.446002 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:54:24.446094 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:54:24.450723 (+ 4629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:54:24.450739 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:54:24.450756 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:54:24.450797 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:54:24.453559 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:24.454252 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:24.454260 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:24.454262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:24.454426 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:54:24.454755 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:54:24.454758 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:54:24.454760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:54:24.455137 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:54:24.455392 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0809 06:54:24.455617 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 06:54:24.455784 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 06:54:24.456924 23609 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:54:24.549541 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 23479
I20260809 06:54:24.570691 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 23068
I20260809 06:54:24.571979 23134 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:54:24.690618 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 23068
I20260809 06:54:24.718262 11061 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 06:54:25.054519 11061 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 06:54:25.054836 11061 mini_ranger.cc:66] Stopping Ranger...
I20260809 06:54:25.411160 11061 mini_ranger.cc:68] Stopped Ranger
2026-08-09 06:54:25.411 UTC [22636] LOG: received smart shutdown request
2026-08-09 06:54:25.416 UTC [22636] LOG: background worker "logical replication launcher" (PID 22645) exited with exit code 1
2026-08-09 06:54:25.416 UTC [22640] LOG: shutting down
2026-08-09 06:54:25.583 UTC [22636] LOG: database system is shut down
2026-08-09T06:54:25Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51516 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:54:25 dist-test-slave-0b58 krb5kdc[23673](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:54:25 dist-test-slave-0b58 krb5kdc[23673](info): set up 2 sockets
Aug 09 06:54:25 dist-test-slave-0b58 krb5kdc[23673](info): commencing operation
krb5kdc: starting...
W20260809 06:54:26.891203 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:54:27 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:54:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:54:27Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.205.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.205.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/rangeradmin_127.10.205.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/rangeradmin_127.10.205.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.205.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.205.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/rangerlookup_127.10.205.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/rangerlookup_127.10.205.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.205.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.205.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/HTTP_127.10.205.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/HTTP_127.10.205.84@KRBTEST.COM.keytab.
I20260809 06:54:27.293716 11061 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskDfk6Nc/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/postgres -l logfile start
2026-08-09 06:54:29.870 UTC [23704] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 06:54:29.870 UTC [23704] LOG: listening on IPv4 address "127.10.205.84", port 50023
2026-08-09 06:54:29.874 UTC [23704] LOG: listening on Unix socket "/tmp/.s.PGSQL.50023"
2026-08-09 06:54:29.896 UTC [23707] LOG: database system was shut down at 2026-08-09 06:54:28 UTC
2026-08-09 06:54:29.900 UTC [23704] LOG: database system is ready to accept connections
I20260809 06:54:30.895316 11061 mini_postgres.cc:96] Postgres bound to 50023
2026-08-09 06:54:30.918 UTC [23716] FATAL: database "slave" does not exist
127.10.205.84:50023 - accepting connections
I20260809 06:54:30.919422 11061 mini_ranger.cc:161] Starting Ranger...
I20260809 06:54:30.954092 11061 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 06:54:31.454391 11061 mini_ranger.cc:87] Created ranger Postgres database
I20260809 06:54:31.454525 11061 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-admin
2026-08-09 06:54:31,759 [I] DB FLAVOR :POSTGRES
2026-08-09 06:54:31,759 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 06:54:31,759 [I] Checking connection..
2026-08-09 06:54:31,759 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 06:54:32,006 [I] Checking connection passed.
2026-08-09 06:54:32,007 [I] --------- Verifying version history table ---------
2026-08-09 06:54:32,007 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 06:54:32,258 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 06:54:32,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 06:54:32,534 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 06:54:32,534 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 06:54:32,534 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 06:54:32.770 UTC [23781] WARNING: there is no transaction in progress
2026-08-09 06:54:32,777 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 06:54:32,778 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 06:54:33,020 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 06:54:33,021 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 06:54:33,021 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 06:54:33,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 06:54:33,559 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-0b58.c.gcp-upstream.internal','N') ;"
2026-08-09 06:54:33,791 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 06:54:34,041 [I] Table x_portal_user does not exist in database ranger
2026-08-09 06:54:34,041 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 06:54:34,294 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 06:54:34,295 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 06:54:34,558 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 06:54:34,819 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 06:54:34,820 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 06:54:35.774 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.792 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.808 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.823 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.842 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.860 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.915 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.922 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.937 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.947 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.960 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.975 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.985 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.992 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:35.999 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:36.005 UTC [23895] WARNING: there is no transaction in progress
2026-08-09 06:54:36,638 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 06:54:36,638 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 06:54:36,874 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 06:54:36,875 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 06:54:37,138 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 06:54:37,138 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 06:54:37,395 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 06:54:37,396 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 06:54:37,663 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 06:54:37,918 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-0b58.c.gcp-upstream.internal';"
2026-08-09 06:54:38,146 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 06:54:38,146 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 06:54:38,407 [I] DB_PATCHES have already been applied
I20260809 06:54:38.413192 11061 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-admin:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskDfk6Nc/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 06:54:38.413309 11061 mini_ranger.cc:193] Using host: 127.10.205.84
I20260809 06:54:38.433738 11061 mini_ranger.cc:227] Ranger admin URL: http://127.10.205.84:57525
Aug 09, 2026 6:54:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:54:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:54:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 6:54:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 6:54:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 6:54:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 6:54:39 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 06:54:39.621162 11061 mini_ranger.cc:160] Time spent starting Ranger: real 8.702s user 0.002s sys 0.058s
Aug 09, 2026 6:55:00 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 6:55:00 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 6:55:00 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 6:55:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 6:55:00 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 6:55:01 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 06:55:02.199841 11061 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.205.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.205.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/rangerkms_127.10.205.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.205.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/rangerkms_127.10.205.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.205.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.205.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.205.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/HTTP_127.10.205.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.205.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/HTTP_127.10.205.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 06:55:02 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258502, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 06:55:02.413757 11061 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 06:55:02.441470 11061 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 06:55:03.315758 11061 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 06:55:03.315861 11061 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-kms
I20260809 06:55:03.315891 11061 mini_ranger_kms.cc:227] Using postgres at 127.10.205.84:50023
2026-08-09 06:55:03,676 [I] DB FLAVOR :POSTGRES
2026-08-09 06:55:03,676 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 06:55:03,676 [I] Checking connection
2026-08-09 06:55:03,676 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 06:55:03,926 [I] connection success
2026-08-09 06:55:03,926 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 06:55:03,926 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 06:55:03,926 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 06:55:04,163 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 06:55:04,164 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 06:55:04,164 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 06:55:04,164 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.205.84:50023/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 06:55:04,435 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 06:55:04.923664 11061 mini_ranger_kms.cc:310] Created kms service
I20260809 06:55:05.113921 11061 mini_ranger_kms.cc:326] Created kudu user
I20260809 06:55:05.163159 11061 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 06:55:05 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258502, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:55:05.643527 11061 mini_ranger_kms.cc:384] Added ranger policy
I20260809 06:55:05.643910 11061 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-kms:/tmp/dist-test-taskDfk6Nc/build/asan/bin/postgresql.jar:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskDfk6Nc/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 06:55:05.643957 11061 mini_ranger_kms.cc:240] Using host: 127.10.205.84
I20260809 06:55:05.668205 11061 mini_ranger_kms.cc:276] Ranger KMS PID: 24083
I20260809 06:55:05.668382 11061 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.205.84:42185
Aug 09, 2026 6:55:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:55:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:55:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 6:55:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 6:55:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 6:55:07 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 06:55:07 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786258507, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.205.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:08.014086 11061 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.600s user 0.073s sys 0.326s
I20260809 06:55:08.014389 11061 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 06:55:08.014629 11061 mini_ranger_kms.cc:401] 127.10.205.84:42185/kms/v1/keys
Aug 09 06:55:08 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258507, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.205.84@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
Aug 09 06:55:08 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258507, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.205.84@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
Aug 09 06:55:11 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:55:11.235960 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:34127
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:34127
--ranger_config_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.205.84:42185/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:11.614034 24134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:11.614430 24134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:11.614602 24134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:11.622228 24134 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:55:11.622427 24134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:11.622545 24134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:11.622653 24134 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:55:11.622736 24134 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:55:11.633734 24134 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.205.84:42185/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:34127
--ranger_config_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:34127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:11.635174 24134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:11.636646 24134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:11.649502 24139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:11.649550 24142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:11.649623 24140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:11.650321 24134 server_base.cc:1034] running on GCE node
I20260809 06:55:11.651121 24134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:11.652673 24134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:11.653905 24134 hybrid_clock.cc:648] HybridClock initialized: now 1786258511653872 us; error 50 us; skew 500 ppm
I20260809 06:55:11.654268 24134 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:11 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258511, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:11.657572 24134 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:55:11.659185 24134 webserver.cc:460] Webserver started at http://127.10.205.126:40739/ using document root <none> and password file <none>
I20260809 06:55:11.659832 24134 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:11.659937 24134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:11.660204 24134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:55:11 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258511, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:55:11.713311 24134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "4fe47b47dd72498a804d67dd3356b49c"
format_stamp: "Formatted at 2026-08-09 06:55:11 on dist-test-slave-0b58"
server_key: "46e169b6e32b28f96b60ff5df667eef4"
server_key_iv: "2bcd3e6186c4a65a656f937ced0bce72"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:11.714267 24134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "4fe47b47dd72498a804d67dd3356b49c"
format_stamp: "Formatted at 2026-08-09 06:55:11 on dist-test-slave-0b58"
server_key: "46e169b6e32b28f96b60ff5df667eef4"
server_key_iv: "2bcd3e6186c4a65a656f937ced0bce72"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:11.720237 24134 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260809 06:55:11.738034 24150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:11.739711 24134 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 06:55:11.739912 24134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "4fe47b47dd72498a804d67dd3356b49c"
format_stamp: "Formatted at 2026-08-09 06:55:11 on dist-test-slave-0b58"
server_key: "46e169b6e32b28f96b60ff5df667eef4"
server_key_iv: "2bcd3e6186c4a65a656f937ced0bce72"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:11.740147 24134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:11.756562 24134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:11.761040 24134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:11.761399 24134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:11.781597 24134 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:34127
I20260809 06:55:11.781637 24201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:34127 every 8 connection(s)
I20260809 06:55:11.783070 24134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:55:11.787067 24202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:11.790410 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 24134
I20260809 06:55:11.790655 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:55:11.791363 11061 external_mini_cluster.cc:1428] Setting key 6ccb439cc90102d3414ad577dc4dc4de
I20260809 06:55:11.801244 24202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c: Bootstrap starting.
I20260809 06:55:11.805435 24202 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:11.806893 24202 log.cc:824] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:55:11 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:11.810143 24202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c: No bootstrap required, opened a new log
I20260809 06:55:11.816025 24205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:11.793550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42934 (local address 127.10.205.126:34127)
0809 06:55:11.794416 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:11.794427 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:11.794468 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:55:11.796132 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:11.796158 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:11.796650 (+ 492us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:11.797002 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:11.798799 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:11.800760 (+ 1961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:11.802662 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:11.803403 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:11.803557 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:11.808580 (+ 5023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:11.808588 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:11.808604 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:11.808638 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:11.811682 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:11.812600 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:11.812607 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:11.812614 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:11.812781 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:11.813190 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:11.813193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:11.813195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:11.813770 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:11.814022 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:11.814484 (+ 462us) server_negotiation.cc:299] Negotiation successful
0809 06:55:11.814877 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":429,"threads_started":1}
I20260809 06:55:11.819784 24202 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe47b47dd72498a804d67dd3356b49c" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34127 } }
I20260809 06:55:11.820233 24202 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:11.820399 24202 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fe47b47dd72498a804d67dd3356b49c, State: Initialized, Role: FOLLOWER
I20260809 06:55:11.821090 24202 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe47b47dd72498a804d67dd3356b49c" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34127 } }
I20260809 06:55:11.821385 24202 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:55:11.821552 24202 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:55:11.821725 24202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:11.823915 24202 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe47b47dd72498a804d67dd3356b49c" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34127 } }
I20260809 06:55:11.824523 24202 leader_election.cc:302] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fe47b47dd72498a804d67dd3356b49c; no voters:
I20260809 06:55:11.825109 24202 leader_election.cc:288] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:55:11.825285 24207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:55:11.825942 24207 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 1 LEADER]: Becoming Leader. State: Replica: 4fe47b47dd72498a804d67dd3356b49c, State: Running, Role: LEADER
I20260809 06:55:11.826488 24207 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe47b47dd72498a804d67dd3356b49c" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34127 } }
I20260809 06:55:11.827373 24202 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:55:11.829586 24208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fe47b47dd72498a804d67dd3356b49c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe47b47dd72498a804d67dd3356b49c" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34127 } } }
I20260809 06:55:11.830075 24208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:11.830556 24209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fe47b47dd72498a804d67dd3356b49c. Latest consensus state: current_term: 1 leader_uuid: "4fe47b47dd72498a804d67dd3356b49c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe47b47dd72498a804d67dd3356b49c" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34127 } } }
I20260809 06:55:11.830938 24209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:11.832600 24215 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:55:11.838786 24215 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:55:11.839591 24202 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 06:55:11.860596 24215 catalog_manager.cc:1347] Generated new cluster ID: 27a34614f08a4de68c5184726a502c9f
I20260809 06:55:11.860764 24215 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:55:11.895781 24215 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:55:11.897897 24215 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:55:11.911652 24215 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c: Generated new TSK 0
I20260809 06:55:11.912890 24215 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:55:12.655413 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.205.84:42185/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34127
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:55:12 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786258512, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 06:55:13.100735 24249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:13.101030 24249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:13.101192 24249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:13.109643 24249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:13.109771 24249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:13.109962 24249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:55:13.122862 24249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.205.84:42185/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34127
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:13.124441 24249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:13.126004 24249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:13.154343 24259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:13.154343 24260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:13.170181 24262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:13.170799 24249 server_base.cc:1034] running on GCE node
I20260809 06:55:13.171768 24249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:13.173275 24249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:13.174583 24249 hybrid_clock.cc:648] HybridClock initialized: now 1786258513174521 us; error 48 us; skew 500 ppm
I20260809 06:55:13.175035 24249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:13 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258513, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:13.179782 24249 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:55:13.182109 24249 webserver.cc:460] Webserver started at http://127.10.205.65:35063/ using document root <none> and password file <none>
I20260809 06:55:13.183274 24249 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:13.183478 24249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:13.183944 24249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:55:13 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258513, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:55:13.209564 24249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "18ce0e717060418a92fb446565b0528a"
format_stamp: "Formatted at 2026-08-09 06:55:13 on dist-test-slave-0b58"
server_key: "64f075d948c07b3ecec9f70bdecfd13a"
server_key_iv: "c5f2e9a69b8ea088e6a4c66afc327c13"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:13.210768 24249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "18ce0e717060418a92fb446565b0528a"
format_stamp: "Formatted at 2026-08-09 06:55:13 on dist-test-slave-0b58"
server_key: "64f075d948c07b3ecec9f70bdecfd13a"
server_key_iv: "c5f2e9a69b8ea088e6a4c66afc327c13"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:13.230594 24249 fs_manager.cc:691] Time spent creating directory manager: real 0.019s user 0.012s sys 0.008s
I20260809 06:55:13.272955 24269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:13.274881 24249 fs_manager.cc:725] Time spent opening block manager: real 0.021s user 0.002s sys 0.015s
I20260809 06:55:13.275125 24249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "18ce0e717060418a92fb446565b0528a"
format_stamp: "Formatted at 2026-08-09 06:55:13 on dist-test-slave-0b58"
server_key: "64f075d948c07b3ecec9f70bdecfd13a"
server_key_iv: "c5f2e9a69b8ea088e6a4c66afc327c13"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:13.275439 24249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:13.300575 24249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:13.305327 24249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:13.305788 24249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:13.315959 24249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:13.326354 24249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:13.326488 24249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:13.326627 24249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:13.326692 24249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:13.415259 24249 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:33403
I20260809 06:55:13.415309 24387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:33403 every 8 connection(s)
I20260809 06:55:13.417093 24249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:55:13.422691 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 24249
I20260809 06:55:13.422943 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:55:13.424069 11061 external_mini_cluster.cc:1428] Setting key 4eda5ff362ea5114e4e3dd21f4e5fb10
Aug 09 06:55:13 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258513, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:13.451069 24391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:13.421763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34127 (local address 127.10.205.65:47397)
0809 06:55:13.424695 (+ 2932us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:13.424751 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:13.427310 (+ 2559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:13.429690 (+ 2380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:13.429704 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:13.430453 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:13.431558 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:13.431591 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:13.433308 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:13.433314 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:13.435502 (+ 2188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:13.435534 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:13.437097 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:13.437104 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:13.437446 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:13.438373 (+ 927us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:13.438408 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:13.441441 (+ 3033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:13.445904 (+ 4463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:13.445915 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:13.445936 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:13.446626 (+ 690us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:13.447107 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:13.447112 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:13.447115 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:13.447435 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:13.448180 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:13.448199 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:13.448701 (+ 502us) client_negotiation.cc:769] Sending connection context
0809 06:55:13.449008 (+ 307us) client_negotiation.cc:240] Negotiation successful
0809 06:55:13.449617 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2571,"thread_start_us":2299,"threads_started":1}
I20260809 06:55:13.452544 24390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:13.420862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:47397 (local address 127.10.205.126:34127)
0809 06:55:13.422910 (+ 2048us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:13.422916 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:13.427755 (+ 4839us) server_negotiation.cc:407] Connection header received
0809 06:55:13.427828 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:13.427833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:13.427921 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:13.428029 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:13.431818 (+ 3789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:13.433051 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:13.435766 (+ 2715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:13.436457 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:13.436604 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:13.441816 (+ 5212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:13.441824 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:13.441828 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:13.441875 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:13.445646 (+ 3771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:13.446799 (+ 1153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:13.446805 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:13.446809 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:13.446976 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:13.447565 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:13.447570 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:13.447572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:13.447964 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:13.448086 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:13.451689 (+ 3603us) server_negotiation.cc:299] Negotiation successful
0809 06:55:13.452133 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1899,"thread_start_us":1760,"threads_started":1}
I20260809 06:55:13.454453 24388 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34127
I20260809 06:55:13.454813 24388 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:13.455830 24388 heartbeater.cc:511] Master 127.10.205.126:34127 requested a full tablet report, sending...
I20260809 06:55:13.458606 24167 ts_manager.cc:194] Registered new tserver with Master: 18ce0e717060418a92fb446565b0528a (127.10.205.65:33403)
I20260809 06:55:13.460611 24167 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:47397
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Aug 09 06:55:13 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258512, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
W20260809 06:55:13.527948 11061 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.205.66: real 0.101s user 0.002s sys 0.023s
I20260809 06:55:13.529084 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.205.84:42185/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34127
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:55:13 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258512, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
W20260809 06:55:14.009326 24394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:14.009869 24394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:14.010074 24394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:14.022342 24394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:14.022598 24394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:14.022845 24394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:55:14.039899 24394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.205.84:42185/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34127
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:14.042110 24394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:14.044211 24394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:14.077425 24402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:14.077507 24403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:14.086443 24394 server_base.cc:1034] running on GCE node
W20260809 06:55:14.087137 24405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:14.088081 24394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:14.089613 24394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:14.090937 24394 hybrid_clock.cc:648] HybridClock initialized: now 1786258514090878 us; error 44 us; skew 500 ppm
I20260809 06:55:14.091363 24394 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:14 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258514, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:14.095963 24394 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:55:14.107151 24394 webserver.cc:460] Webserver started at http://127.10.205.66:34495/ using document root <none> and password file <none>
I20260809 06:55:14.108543 24394 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:14.108788 24394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:14.109285 24394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:55:14 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258514, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:55:14.133226 24394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "57781b3d92464a9085946c47a35b6345"
format_stamp: "Formatted at 2026-08-09 06:55:14 on dist-test-slave-0b58"
server_key: "a974a909e603a3be00bde644927d759d"
server_key_iv: "815528d7a68e1da5eaa898889ae9008a"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:14.134471 24394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "57781b3d92464a9085946c47a35b6345"
format_stamp: "Formatted at 2026-08-09 06:55:14 on dist-test-slave-0b58"
server_key: "a974a909e603a3be00bde644927d759d"
server_key_iv: "815528d7a68e1da5eaa898889ae9008a"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:14.142367 24394 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.008s
I20260809 06:55:14.161257 24420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:14.164554 24394 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.005s sys 0.000s
I20260809 06:55:14.164888 24394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "57781b3d92464a9085946c47a35b6345"
format_stamp: "Formatted at 2026-08-09 06:55:14 on dist-test-slave-0b58"
server_key: "a974a909e603a3be00bde644927d759d"
server_key_iv: "815528d7a68e1da5eaa898889ae9008a"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:14.165313 24394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:14.192683 24394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:14.198520 24394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:14.198964 24394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:14.200358 24394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:14.202278 24394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:14.202422 24394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 06:55:14.202620 24394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:14.202765 24394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:14.273339 24394 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:38589
I20260809 06:55:14.273389 24535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:38589 every 8 connection(s)
I20260809 06:55:14.275184 24394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:55:14.284077 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 24394
I20260809 06:55:14.284344 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:55:14.284932 11061 external_mini_cluster.cc:1428] Setting key 835e8323cc2989942a97cc6eb8575fb7
Aug 09 06:55:14 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258514, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:14.324208 24538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:14.278250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:45465 (local address 127.10.205.126:34127)
0809 06:55:14.293556 (+ 15306us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:14.293563 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:14.297515 (+ 3952us) server_negotiation.cc:407] Connection header received
0809 06:55:14.300914 (+ 3399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:14.300921 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:14.301039 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:14.301171 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:14.303776 (+ 2605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:14.304967 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:14.307470 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:14.308157 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:14.308351 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:14.316425 (+ 8074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:14.316433 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:14.316439 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:14.316487 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:14.320093 (+ 3606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:14.321231 (+ 1138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:14.321237 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:14.321241 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:14.321404 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:14.321978 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:14.321983 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:14.321986 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:14.322350 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:14.322465 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:14.323508 (+ 1043us) server_negotiation.cc:299] Negotiation successful
0809 06:55:14.323772 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15155,"thread_start_us":15312,"threads_started":1}
I20260809 06:55:14.326242 24539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:14.278985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34127 (local address 127.10.205.66:45465)
0809 06:55:14.294371 (+ 15386us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:14.294444 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:14.297098 (+ 2654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:14.301849 (+ 4751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:14.301863 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:14.302675 (+ 812us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:14.303528 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:14.303556 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:14.305200 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:14.305207 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:14.307281 (+ 2074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:14.307308 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:14.308485 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:14.308492 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:14.308797 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:14.313021 (+ 4224us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:14.313056 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:14.316011 (+ 2955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:14.320374 (+ 4363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:14.320386 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:14.320406 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:14.321054 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:14.321553 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:14.321557 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:14.321561 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:14.321852 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:14.322582 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:14.322591 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:14.323036 (+ 445us) client_negotiation.cc:769] Sending connection context
0809 06:55:14.324189 (+ 1153us) client_negotiation.cc:240] Negotiation successful
0809 06:55:14.324813 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14976,"thread_start_us":17177,"threads_started":1}
I20260809 06:55:14.328111 24536 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34127
I20260809 06:55:14.328461 24536 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:14.329351 24536 heartbeater.cc:511] Master 127.10.205.126:34127 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
I20260809 06:55:14.331133 24167 ts_manager.cc:194] Registered new tserver with Master: 57781b3d92464a9085946c47a35b6345 (127.10.205.66:38589)
I20260809 06:55:14.332337 24167 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:45465
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:55:14.375847 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.205.84:42185/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34127
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:55:14.464569 24388 heartbeater.cc:503] Master 127.10.205.126:34127 was elected leader, sending a full tablet report...
W20260809 06:55:14.803889 24542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:14.804177 24542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:14.804314 24542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:14.811615 24542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:14.811791 24542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:14.811980 24542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:55:14.822232 24542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.205.84:42185/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34127
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:14.823666 24542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:14.825146 24542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:14.839162 24547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:14.839221 24550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:14.839246 24548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:14.840423 24542 server_base.cc:1034] running on GCE node
I20260809 06:55:14.841171 24542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:14.842198 24542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:14.843470 24542 hybrid_clock.cc:648] HybridClock initialized: now 1786258514843412 us; error 44 us; skew 500 ppm
I20260809 06:55:14.843824 24542 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:14 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258514, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:14.847287 24542 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:55:14.848827 24542 webserver.cc:460] Webserver started at http://127.10.205.67:36085/ using document root <none> and password file <none>
I20260809 06:55:14.849539 24542 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:14.849646 24542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:14.849923 24542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:55:14 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258514, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:55:14.865185 24542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "6bc130a624144d6cbbcd179e26b1f538"
format_stamp: "Formatted at 2026-08-09 06:55:14 on dist-test-slave-0b58"
server_key: "86a11bc4b8e6921e94d9b1bac756a280"
server_key_iv: "a6f2501f2d2a896cc3085b21ee819b2a"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:14.866437 24542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "6bc130a624144d6cbbcd179e26b1f538"
format_stamp: "Formatted at 2026-08-09 06:55:14 on dist-test-slave-0b58"
server_key: "86a11bc4b8e6921e94d9b1bac756a280"
server_key_iv: "a6f2501f2d2a896cc3085b21ee819b2a"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:14.874089 24542 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260809 06:55:14.890264 24557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:14.892001 24542 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260809 06:55:14.892210 24542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "6bc130a624144d6cbbcd179e26b1f538"
format_stamp: "Formatted at 2026-08-09 06:55:14 on dist-test-slave-0b58"
server_key: "86a11bc4b8e6921e94d9b1bac756a280"
server_key_iv: "a6f2501f2d2a896cc3085b21ee819b2a"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:14.892517 24542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:14.907557 24542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:14.911407 24542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:14.911742 24542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:14.912858 24542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:14.914310 24542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:14.914415 24542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:14.914567 24542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:14.914646 24542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:14.949102 24542 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:42539
I20260809 06:55:14.949152 24673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:42539 every 8 connection(s)
I20260809 06:55:14.950434 24542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:55:14.957381 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 24542
I20260809 06:55:14.957573 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:55:14.958081 11061 external_mini_cluster.cc:1428] Setting key ac8b31ee92ccb834bef39b90ed7c88aa
Aug 09 06:55:14 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258514, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:14.970278 24676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:14.953111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:44055 (local address 127.10.205.126:34127)
0809 06:55:14.953674 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:14.953678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:14.954598 (+ 920us) server_negotiation.cc:407] Connection header received
0809 06:55:14.956433 (+ 1835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:14.956438 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:14.956528 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:14.956646 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:14.958195 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:14.959160 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:14.960846 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:14.961452 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:14.961552 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:14.965010 (+ 3458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:14.965015 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:14.965018 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:14.965051 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:14.967529 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:14.968244 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:14.968248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:14.968250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:14.968439 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:14.968812 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:14.968816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:14.968817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:14.969076 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:14.969183 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:14.969843 (+ 660us) server_negotiation.cc:299] Negotiation successful
0809 06:55:14.970012 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":269,"threads_started":1}
I20260809 06:55:14.971300 24677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:14.953712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34127 (local address 127.10.205.67:44055)
0809 06:55:14.954432 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:14.954468 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:14.956088 (+ 1620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:14.956888 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:14.956896 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:14.957318 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:14.958014 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:14.958032 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:14.959355 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:14.959359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:14.960698 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:14.960718 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:14.961648 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:14.961652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:14.961857 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:14.962597 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:14.962620 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:14.964794 (+ 2174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:14.967662 (+ 2868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:14.967669 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:14.967683 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:14.968125 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:14.968534 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:14.968537 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:14.968540 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:14.968713 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:14.969179 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:14.969185 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:14.969509 (+ 324us) client_negotiation.cc:769] Sending connection context
0809 06:55:14.969745 (+ 236us) client_negotiation.cc:240] Negotiation successful
0809 06:55:14.970128 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":276,"threads_started":1}
I20260809 06:55:14.973074 24674 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34127
I20260809 06:55:14.973435 24674 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:14.974298 24674 heartbeater.cc:511] Master 127.10.205.126:34127 requested a full tablet report, sending...
I20260809 06:55:14.975852 24166 ts_manager.cc:194] Registered new tserver with Master: 6bc130a624144d6cbbcd179e26b1f538 (127.10.205.67:42539)
I20260809 06:55:14.976822 24166 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:44055
I20260809 06:55:14.986537 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:55:14.988343 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 24249
Aug 09 06:55:14 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:55:15.005501 24679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:14.989362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38890 (local address 127.10.205.65:33403)
0809 06:55:14.990041 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:14.990048 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:14.990075 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:55:14.990139 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:14.990146 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:14.990355 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:14.990489 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:14.992042 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:14.993110 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:14.994596 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:14.995169 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:14.995286 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:14.999749 (+ 4463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:14.999762 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:14.999777 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:14.999812 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:15.002908 (+ 3096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:15.003639 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:15.003646 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:15.003648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:15.003797 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:15.004109 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:15.004113 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:15.004115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:15.004548 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:15.004800 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:15.005023 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 06:55:15.005222 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":367,"threads_started":1}
I20260809 06:55:15.006860 24383 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:15.091859 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 24249
I20260809 06:55:15.113047 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 24394
Aug 09 06:55:15 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:55:15.134824 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:15.118587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38470 (local address 127.10.205.66:38589)
0809 06:55:15.119149 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:15.119156 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:15.119180 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:55:15.119237 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:15.119244 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:15.119472 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:15.119645 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:15.121101 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:15.122138 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:15.123470 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:15.124058 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:15.124221 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:15.128844 (+ 4623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:15.128866 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:15.128900 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:15.128947 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:15.131822 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:15.132730 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:15.132737 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:15.132740 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:15.132905 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:15.133328 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:15.133331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:15.133333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:15.133681 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:15.133913 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:15.134194 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 06:55:15.134440 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":284,"threads_started":1}
I20260809 06:55:15.136183 24530 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:15.219676 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 24394
I20260809 06:55:15.239462 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 24542
Aug 09 06:55:15 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:55:15.256778 24683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:15.240645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37536 (local address 127.10.205.67:42539)
0809 06:55:15.241360 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:15.241367 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:15.241398 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:55:15.241464 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:15.241470 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:15.241751 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:15.241941 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:15.243413 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:15.244761 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:15.246209 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:15.246788 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:15.246906 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:15.251295 (+ 4389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:15.251306 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:15.251320 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:15.251360 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:15.254293 (+ 2933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:15.254907 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:15.254913 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:15.254915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:15.255044 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:15.255355 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:15.255358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:15.255360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:15.255705 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:15.255939 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:15.256215 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 06:55:15.256470 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":391,"threads_started":1}
I20260809 06:55:15.258111 24669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:15.342013 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 24542
I20260809 06:55:15.361969 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 24134
I20260809 06:55:15.363305 24197 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:15.473830 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 24134
I20260809 06:55:15.497833 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:34127
--webserver_interface=127.10.205.126
--webserver_port=40739
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:34127
--ranger_config_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.205.84:42185/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.205.84:42185/kms with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:15.839249 24686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:15.839622 24686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:15.839785 24686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:15.847078 24686 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:55:15.847239 24686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:15.847383 24686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:15.847493 24686 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:55:15.847575 24686 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:55:15.858064 24686 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.205.84:42185/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:34127
--ranger_config_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:34127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=40739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:15.859632 24686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:15.861140 24686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:15.873543 24691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:15.873522 24694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:15.874184 24692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:15.877790 24686 server_base.cc:1034] running on GCE node
I20260809 06:55:15.878695 24686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:15.880223 24686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:15.881518 24686 hybrid_clock.cc:648] HybridClock initialized: now 1786258515881479 us; error 41 us; skew 500 ppm
I20260809 06:55:15.881917 24686 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:15 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258515, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:15.885105 24686 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:55:15.886693 24686 webserver.cc:460] Webserver started at http://127.10.205.126:40739/ using document root <none> and password file <none>
I20260809 06:55:15.887460 24686 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:15.887605 24686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 06:55:15 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258515, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:55:15.937352 24686 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 06:55:15.940624 24703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:15.942176 24686 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:55:15.942387 24686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "4fe47b47dd72498a804d67dd3356b49c"
format_stamp: "Formatted at 2026-08-09 06:55:11 on dist-test-slave-0b58"
server_key: "46e169b6e32b28f96b60ff5df667eef4"
server_key_iv: "2bcd3e6186c4a65a656f937ced0bce72"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:15.943393 24686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:15.955085 24686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:15.959086 24686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:15.959410 24686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:15.978417 24686 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:34127
I20260809 06:55:15.978436 24756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:34127 every 8 connection(s)
I20260809 06:55:15.980033 24686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:55:15.986946 24758 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:55:15.987627 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 24686
I20260809 06:55:15.988758 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.205.84:42185/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:33403
--local_ip_for_outbound_sockets=127.10.205.65
--tserver_master_addrs=127.10.205.126:34127
--webserver_port=35063
--webserver_interface=127.10.205.65
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.205.84:42185/kms with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:55:15.992038 24758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c: Bootstrap starting.
I20260809 06:55:16.013566 24758 log.cc:824] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:16.022878 24758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:55:16.023437 24758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c: Bootstrap complete.
I20260809 06:55:16.032828 24758 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe47b47dd72498a804d67dd3356b49c" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34127 } }
I20260809 06:55:16.033674 24758 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fe47b47dd72498a804d67dd3356b49c, State: Initialized, Role: FOLLOWER
I20260809 06:55:16.034365 24758 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe47b47dd72498a804d67dd3356b49c" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34127 } }
I20260809 06:55:16.034600 24758 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:55:16.034744 24758 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:55:16.034940 24758 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 1 FOLLOWER]: Advancing to term 2
I20260809 06:55:16.038857 24758 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe47b47dd72498a804d67dd3356b49c" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34127 } }
I20260809 06:55:16.039367 24758 leader_election.cc:302] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fe47b47dd72498a804d67dd3356b49c; no voters:
I20260809 06:55:16.040035 24758 leader_election.cc:288] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 06:55:16.040194 24763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 2 FOLLOWER]: Leader election won for term 2
I20260809 06:55:16.041356 24763 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [term 2 LEADER]: Becoming Leader. State: Replica: 4fe47b47dd72498a804d67dd3356b49c, State: Running, Role: LEADER
I20260809 06:55:16.042055 24763 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe47b47dd72498a804d67dd3356b49c" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34127 } }
I20260809 06:55:16.042310 24758 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:55:16.046532 24764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4fe47b47dd72498a804d67dd3356b49c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe47b47dd72498a804d67dd3356b49c" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34127 } } }
I20260809 06:55:16.047015 24764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:16.047792 24765 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fe47b47dd72498a804d67dd3356b49c. Latest consensus state: current_term: 2 leader_uuid: "4fe47b47dd72498a804d67dd3356b49c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe47b47dd72498a804d67dd3356b49c" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34127 } } }
I20260809 06:55:16.048116 24765 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:16.061221 24772 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:55:16.072006 24772 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:55:16.073613 24772 catalog_manager.cc:1259] Loaded cluster ID: 27a34614f08a4de68c5184726a502c9f
I20260809 06:55:16.073825 24772 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:55:16.077809 24772 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:55:16.079376 24772 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c: Loaded TSK: 0
I20260809 06:55:16.081444 24772 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:55:16.084491 24758 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260809 06:55:16.443996 24760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:16.444613 24760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:16.444835 24760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:16.453918 24760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:16.454078 24760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:16.454265 24760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:55:16.470041 24760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.205.84:42185/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:33403
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=35063
--tserver_master_addrs=127.10.205.126:34127
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:16.472208 24760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:16.474045 24760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:16.505772 24798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:16.506620 24799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:16.534175 24760 server_base.cc:1034] running on GCE node
W20260809 06:55:16.535310 24801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:16.536408 24760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:16.542315 24760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:16.543673 24760 hybrid_clock.cc:648] HybridClock initialized: now 1786258516543607 us; error 61 us; skew 500 ppm
I20260809 06:55:16.544349 24760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:16 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258516, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:16.549314 24760 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:55:16.557752 24760 webserver.cc:460] Webserver started at http://127.10.205.65:35063/ using document root <none> and password file <none>
I20260809 06:55:16.559001 24760 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:16.559201 24760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 06:55:16 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258516, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:55:16.618366 24760 fs_manager.cc:709] Time spent opening directory manager: real 0.033s user 0.013s sys 0.016s
I20260809 06:55:16.633041 24809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:16.636055 24760 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.004s sys 0.007s
I20260809 06:55:16.636325 24760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "18ce0e717060418a92fb446565b0528a"
format_stamp: "Formatted at 2026-08-09 06:55:13 on dist-test-slave-0b58"
server_key: "64f075d948c07b3ecec9f70bdecfd13a"
server_key_iv: "c5f2e9a69b8ea088e6a4c66afc327c13"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:16.637992 24760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:16.679369 24760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:16.684046 24760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:16.684525 24760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:16.688748 24760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:16.691800 24760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:16.691941 24760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:16.692082 24760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:16.692174 24760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:16.753069 24760 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:33403
I20260809 06:55:16.753122 24924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:33403 every 8 connection(s)
I20260809 06:55:16.754796 24760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:55:16.756247 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 24760
I20260809 06:55:16.757267 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.205.84:42185/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:38589
--local_ip_for_outbound_sockets=127.10.205.66
--tserver_master_addrs=127.10.205.126:34127
--webserver_port=34495
--webserver_interface=127.10.205.66
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.205.84:42185/kms with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:55:16 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258516, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:16.810449 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:16.759275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34127 (local address 127.10.205.65:51551)
0809 06:55:16.770381 (+ 11106us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:16.770453 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:16.774449 (+ 3996us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:16.777665 (+ 3216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:16.777678 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:16.778433 (+ 755us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:16.779944 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:16.779980 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:16.790059 (+ 10079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:16.790070 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:16.792800 (+ 2730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:16.792829 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:16.794706 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:16.794717 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:16.795096 (+ 379us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:16.796090 (+ 994us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:16.796128 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:16.799432 (+ 3304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:16.804454 (+ 5022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:16.804467 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:16.804486 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:16.805195 (+ 709us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:16.805821 (+ 626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:16.805826 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:16.805830 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:16.806095 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:16.807323 (+ 1228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:16.807332 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:16.807803 (+ 471us) client_negotiation.cc:769] Sending connection context
0809 06:55:16.808126 (+ 323us) client_negotiation.cc:240] Negotiation successful
0809 06:55:16.808807 (+ 681us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10692,"thread_start_us":1896,"threads_started":1}
I20260809 06:55:16.813267 24928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:16.760909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:51551 (local address 127.10.205.126:34127)
0809 06:55:16.771703 (+ 10794us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:16.771732 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:16.771805 (+ 73us) server_negotiation.cc:407] Connection header received
0809 06:55:16.775450 (+ 3645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:16.775473 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:16.776045 (+ 572us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:16.776541 (+ 496us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:16.780346 (+ 3805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:16.789740 (+ 9394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:16.793121 (+ 3381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:16.794391 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:16.794634 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:16.799974 (+ 5340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:16.799986 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:16.800009 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:16.800063 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:16.804156 (+ 4093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:16.805381 (+ 1225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:16.805394 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:16.805405 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:16.805644 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:16.806281 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:16.806287 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:16.806291 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:16.807020 (+ 729us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:16.807215 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:16.811272 (+ 4057us) server_negotiation.cc:299] Negotiation successful
0809 06:55:16.811813 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10390,"thread_start_us":10753,"threads_started":1}
I20260809 06:55:16.817353 24925 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34127
I20260809 06:55:16.817710 24925 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:16.818550 24925 heartbeater.cc:511] Master 127.10.205.126:34127 requested a full tablet report, sending...
W20260809 06:55:16.822079 24925 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:34127 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 06:55:16.822356 24925 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:16.822674 24925 heartbeater.cc:511] Master 127.10.205.126:34127 requested a full tablet report, sending...
I20260809 06:55:16.824144 24925 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:16.824482 24925 heartbeater.cc:511] Master 127.10.205.126:34127 requested a full tablet report, sending...
W20260809 06:55:16.825835 24925 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 06:55:17.214371 24929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:17.214840 24929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:17.215044 24929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:17.223006 24929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:17.223168 24929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:17.223357 24929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:55:17.234591 24929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.205.84:42185/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:38589
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=34495
--tserver_master_addrs=127.10.205.126:34127
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:17.236027 24929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:17.237486 24929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:17.253048 24945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:17.253114 24944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:17.253844 24947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:17.254443 24929 server_base.cc:1034] running on GCE node
I20260809 06:55:17.255116 24929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:17.256299 24929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:17.257532 24929 hybrid_clock.cc:648] HybridClock initialized: now 1786258517257469 us; error 60 us; skew 500 ppm
I20260809 06:55:17.258046 24929 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:17 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258517, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:17.262603 24929 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:55:17.288774 24929 webserver.cc:460] Webserver started at http://127.10.205.66:34495/ using document root <none> and password file <none>
I20260809 06:55:17.290063 24929 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:17.290380 24929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 06:55:17 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258517, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:55:17.338871 24929 fs_manager.cc:709] Time spent opening directory manager: real 0.015s user 0.011s sys 0.003s
I20260809 06:55:17.343290 24957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:17.345571 24929 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260809 06:55:17.345798 24929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "57781b3d92464a9085946c47a35b6345"
format_stamp: "Formatted at 2026-08-09 06:55:14 on dist-test-slave-0b58"
server_key: "a974a909e603a3be00bde644927d759d"
server_key_iv: "815528d7a68e1da5eaa898889ae9008a"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:17.347651 24929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:17.391999 24929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
Aug 09 06:55:17 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786258517, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:17.397778 24929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:17.398144 24929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:17.399564 24929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:17.401795 24929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:17.401923 24929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:17.402058 24929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:17.402139 24929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:17.468205 24929 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:38589
I20260809 06:55:17.468287 25074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:38589 every 8 connection(s)
I20260809 06:55:17.469925 24929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:55:17.475826 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 24929
I20260809 06:55:17.476723 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.205.84:42185/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:42539
--local_ip_for_outbound_sockets=127.10.205.67
--tserver_master_addrs=127.10.205.126:34127
--webserver_port=36085
--webserver_interface=127.10.205.67
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.205.84:42185/kms with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:55:17 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258517, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:17.504043 25078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:17.474428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:37561 (local address 127.10.205.126:34127)
0809 06:55:17.475884 (+ 1456us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:17.475893 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:17.477040 (+ 1147us) server_negotiation.cc:407] Connection header received
0809 06:55:17.482647 (+ 5607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:17.482656 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:17.482926 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:17.483366 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:17.485745 (+ 2379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:17.487020 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:17.489689 (+ 2669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:17.490515 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:17.490668 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:17.495458 (+ 4790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:17.495466 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:17.495471 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:17.495519 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:17.499710 (+ 4191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:17.500852 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:17.500858 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:17.500862 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:17.501022 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:17.501653 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:17.501658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:17.501661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:17.502044 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:17.502231 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:17.503392 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0809 06:55:17.503671 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1274,"thread_start_us":1135,"threads_started":1}
I20260809 06:55:17.506922 25077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:17.473752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34127 (local address 127.10.205.66:37561)
0809 06:55:17.476524 (+ 2772us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:17.476585 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:17.482200 (+ 5615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:17.483668 (+ 1468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:17.483682 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:17.484425 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:17.485413 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:17.485445 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:17.487238 (+ 1793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:17.487243 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:17.489480 (+ 2237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:17.489509 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:17.490812 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:17.490821 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:17.491133 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:17.492020 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:17.492066 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:17.495129 (+ 3063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:17.499926 (+ 4797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:17.499938 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:17.499961 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:17.500691 (+ 730us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:17.501189 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:17.501196 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:17.501201 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:17.501481 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:17.502348 (+ 867us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:17.502356 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:17.502897 (+ 541us) client_negotiation.cc:769] Sending connection context
0809 06:55:17.504689 (+ 1792us) client_negotiation.cc:240] Negotiation successful
0809 06:55:17.505352 (+ 663us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2455,"thread_start_us":2200,"threads_started":1}
I20260809 06:55:17.509248 25075 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34127
I20260809 06:55:17.509600 25075 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:17.510339 25075 heartbeater.cc:511] Master 127.10.205.126:34127 requested a full tablet report, sending...
I20260809 06:55:17.512493 24720 ts_manager.cc:194] Registered new tserver with Master: 57781b3d92464a9085946c47a35b6345 (127.10.205.66:38589)
I20260809 06:55:17.514703 24720 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:37561
I20260809 06:55:17.825992 24925 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:17.826539 24925 heartbeater.cc:511] Master 127.10.205.126:34127 requested a full tablet report, sending...
I20260809 06:55:17.828032 24720 ts_manager.cc:194] Registered new tserver with Master: 18ce0e717060418a92fb446565b0528a (127.10.205.65:33403)
I20260809 06:55:17.829571 24720 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:51551
Aug 09 06:55:17 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258517, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
W20260809 06:55:17.911556 25079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:17.911994 25079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:17.912271 25079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:17.923933 25079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:17.924158 25079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:17.924419 25079 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:55:17.939512 25079 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.205.84:42185/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:42539
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=36085
--tserver_master_addrs=127.10.205.126:34127
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:17.941560 25079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:17.943461 25079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:17.978096 25086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:17.981385 25085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:17.982004 25089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:17.982506 25079 server_base.cc:1034] running on GCE node
I20260809 06:55:17.983518 25079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:17.992550 25079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:17.995954 25079 hybrid_clock.cc:648] HybridClock initialized: now 1786258517995870 us; error 72 us; skew 500 ppm
I20260809 06:55:17.996429 25079 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:17 dist-test-slave-0b58 krb5kdc[23673](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258517, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:18.000202 25079 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:55:18.002266 25079 webserver.cc:460] Webserver started at http://127.10.205.67:36085/ using document root <none> and password file <none>
I20260809 06:55:18.003039 25079 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:18.003216 25079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 06:55:18 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258517, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:55:18.033666 25079 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.001s
I20260809 06:55:18.047806 25096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:18.049957 25079 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.007s sys 0.006s
I20260809 06:55:18.050158 25079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "6bc130a624144d6cbbcd179e26b1f538"
format_stamp: "Formatted at 2026-08-09 06:55:14 on dist-test-slave-0b58"
server_key: "86a11bc4b8e6921e94d9b1bac756a280"
server_key_iv: "a6f2501f2d2a896cc3085b21ee819b2a"
server_key_version: "kuduclusterkey@0"
I20260809 06:55:18.051621 25079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:18.089231 25079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:18.095243 25079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:18.095638 25079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:18.097218 25079 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:18.099946 25079 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:18.100075 25079 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:18.100200 25079 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:18.100317 25079 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:18.151216 25079 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:42539
I20260809 06:55:18.151307 25212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:42539 every 8 connection(s)
I20260809 06:55:18.153307 25079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:55:18.156893 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 25079
Aug 09 06:55:18 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258517, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:18.208971 25215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.158449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42944 (local address 127.10.205.126:34127)
0809 06:55:18.184983 (+ 26534us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:18.184989 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:18.185010 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:55:18.185064 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:18.185070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:18.185160 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:18.185282 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:18.187338 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.188636 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.195142 (+ 6506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.196765 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.197063 (+ 298us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.201166 (+ 4103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:18.201175 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:18.201183 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:18.201245 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:18.204629 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:18.206088 (+ 1459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:18.206094 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:18.206098 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:18.206290 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:18.206965 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:18.206974 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:18.206978 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:18.207428 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:18.207711 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:18.208072 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 06:55:18.208345 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":26377,"thread_start_us":24692,"threads_started":1}
I20260809 06:55:18.211741 25218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.161395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34127 (local address 127.10.205.67:57017)
0809 06:55:18.173106 (+ 11711us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:18.173203 (+ 97us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:18.176732 (+ 3529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:18.183366 (+ 6634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:18.183391 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:18.184236 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:18.185263 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:18.185292 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.189114 (+ 3822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.189120 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:18.191267 (+ 2147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:18.191296 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.192501 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.192511 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:18.192823 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.193708 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:18.193747 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:18.196579 (+ 2832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:18.204549 (+ 7970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:18.204560 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:18.204580 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:18.205191 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:18.206512 (+ 1321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:18.206518 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:18.206522 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:18.206788 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:18.208747 (+ 1959us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:18.208757 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:18.209287 (+ 530us) client_negotiation.cc:769] Sending connection context
0809 06:55:18.209615 (+ 328us) client_negotiation.cc:240] Negotiation successful
0809 06:55:18.210225 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11251,"thread_start_us":10969,"threads_started":1}
I20260809 06:55:18.213722 25217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.156562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:57017 (local address 127.10.205.126:34127)
0809 06:55:18.182671 (+ 26109us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:18.182677 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:18.182704 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:55:18.182775 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:18.182780 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:18.182865 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:18.183005 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:18.186227 (+ 3222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.188916 (+ 2689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.191501 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.192157 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.197307 (+ 5150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.197538 (+ 231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:18.197543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:18.197548 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:18.197581 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:18.204372 (+ 6791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:18.206111 (+ 1739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:18.206138 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:18.206141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:18.206317 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:18.206914 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:18.206919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:18.206922 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:18.207399 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:18.212921 (+ 5522us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:18.213060 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 06:55:18.213324 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":25958,"thread_start_us":28265,"threads_started":1}
I20260809 06:55:18.215173 25213 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34127
I20260809 06:55:18.215525 25213 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:18.216689 25213 heartbeater.cc:511] Master 127.10.205.126:34127 requested a full tablet report, sending...
I20260809 06:55:18.218568 24720 ts_manager.cc:194] Registered new tserver with Master: 6bc130a624144d6cbbcd179e26b1f538 (127.10.205.67:42539)
I20260809 06:55:18.219749 24720 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:57017
I20260809 06:55:18.225318 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 06:55:18 dist-test-slave-0b58 krb5kdc[23673](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258517, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for HTTP/127.10.205.84@KRBTEST.COM
I20260809 06:55:18.251406 25217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.231085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42948 (local address 127.10.205.126:34127)
0809 06:55:18.231291 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:18.231297 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:18.233603 (+ 2306us) server_negotiation.cc:407] Connection header received
0809 06:55:18.233679 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:18.233685 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:18.233764 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:18.233876 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:18.236139 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.237238 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.239420 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.240077 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.240199 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.244019 (+ 3820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:18.244026 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:18.244031 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:18.244071 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:18.248020 (+ 3949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:18.248893 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:18.248898 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:18.248902 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:18.249058 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:18.249513 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:18.249518 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:18.249521 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:18.249907 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:18.250172 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:18.250801 (+ 629us) server_negotiation.cc:299] Negotiation successful
0809 06:55:18.251046 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 06:55:18.259171 24720 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42948:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:55:18.270824 24720 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:55:18.408186 25233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.327490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:42539 (local address 127.0.0.1:37538)
0809 06:55:18.386336 (+ 58846us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:18.386357 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:18.386490 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:18.389792 (+ 3302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:18.389799 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:18.389832 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:18.390196 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:18.390213 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.396574 (+ 6361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.396580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:18.399202 (+ 2622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:18.399221 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.407032 (+ 7811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.407039 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:18.407279 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.407351 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 06:55:18.407547 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 06:55:18.407792 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58727,"thread_start_us":60530,"threads_started":1}
I20260809 06:55:18.410081 25232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.328212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37538 (local address 127.10.205.67:42539)
0809 06:55:18.385889 (+ 57677us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:18.385899 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:18.388526 (+ 2627us) server_negotiation.cc:407] Connection header received
0809 06:55:18.388675 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:18.388684 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:18.388991 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:18.389268 (+ 277us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:18.390448 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.396369 (+ 5921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.405069 (+ 8700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.406768 (+ 1699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.406907 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.407149 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:18.408836 (+ 1687us) server_negotiation.cc:299] Negotiation successful
0809 06:55:18.409015 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57473,"thread_start_us":58793,"threads_started":1}
I20260809 06:55:18.414510 25146 tablet_service.cc:1467] Processing CreateTablet for tablet f4102fd4bbd44049ab92bfddda61a221 (DEFAULT_TABLE table=test-table [id=f7fe0cabf2874d5faaa3cbe7ddbb6712]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:55:18.416288 25146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4102fd4bbd44049ab92bfddda61a221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:18.417445 25229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.339271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:38589 (local address 127.0.0.1:38482)
0809 06:55:18.392571 (+ 53300us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:18.392594 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:18.392901 (+ 307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:18.400878 (+ 7977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:18.400882 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:18.400913 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:18.401255 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:18.401268 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.403301 (+ 2033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.403306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:18.412319 (+ 9013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:18.412338 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.416613 (+ 4275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.416620 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:18.416814 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.416851 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 06:55:18.416960 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 06:55:18.417117 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53135,"thread_start_us":47978,"threads_started":1}
I20260809 06:55:18.418324 25234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.339909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38482 (local address 127.10.205.66:38589)
0809 06:55:18.387006 (+ 47097us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:18.387016 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:18.392782 (+ 5766us) server_negotiation.cc:407] Connection header received
0809 06:55:18.393131 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:18.393141 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:18.395443 (+ 2302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:18.395681 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:18.401458 (+ 5777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.403115 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.412545 (+ 9430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.414029 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.414171 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.414364 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:18.417826 (+ 3462us) server_negotiation.cc:299] Negotiation successful
0809 06:55:18.418010 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46925,"thread_start_us":48277,"threads_started":1}
I20260809 06:55:18.423326 25006 tablet_service.cc:1467] Processing CreateTablet for tablet f4102fd4bbd44049ab92bfddda61a221 (DEFAULT_TABLE table=test-table [id=f7fe0cabf2874d5faaa3cbe7ddbb6712]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:55:18.426200 25006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4102fd4bbd44049ab92bfddda61a221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:18.438987 25231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.326422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33403 (local address 127.0.0.1:38894)
0809 06:55:18.384815 (+ 58393us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:18.384875 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:18.385136 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:18.408402 (+ 23266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:18.408408 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:18.408436 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:18.408775 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:18.408787 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.432374 (+ 23587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.432381 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:18.436089 (+ 3708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:18.436110 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.438135 (+ 2025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.438141 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:18.438324 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.438363 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 06:55:18.438478 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 06:55:18.438627 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58033,"thread_start_us":72906,"threads_started":1}
I20260809 06:55:18.444166 25230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.326726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38894 (local address 127.10.205.65:33403)
0809 06:55:18.407713 (+ 80987us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:18.407723 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:18.407754 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:55:18.407855 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:18.407864 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:18.408143 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:18.409243 (+ 1100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:18.409501 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.419408 (+ 9907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.436378 (+ 16970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.437909 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.438073 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.438354 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:18.443603 (+ 5249us) server_negotiation.cc:299] Negotiation successful
0809 06:55:18.443797 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80768,"thread_start_us":81539,"threads_started":1}
I20260809 06:55:18.448546 24859 tablet_service.cc:1467] Processing CreateTablet for tablet f4102fd4bbd44049ab92bfddda61a221 (DEFAULT_TABLE table=test-table [id=f7fe0cabf2874d5faaa3cbe7ddbb6712]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:55:18.450160 24859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4102fd4bbd44049ab92bfddda61a221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:18.481132 25235 tablet_bootstrap.cc:492] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538: Bootstrap starting.
I20260809 06:55:18.481945 25236 tablet_bootstrap.cc:492] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345: Bootstrap starting.
I20260809 06:55:18.508901 25236 tablet_bootstrap.cc:654] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:18.509755 25235 tablet_bootstrap.cc:654] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:18.511186 25235 log.cc:824] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:18.512601 25236 log.cc:824] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:18.520150 25075 heartbeater.cc:503] Master 127.10.205.126:34127 was elected leader, sending a full tablet report...
I20260809 06:55:18.521044 25237 tablet_bootstrap.cc:492] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a: Bootstrap starting.
I20260809 06:55:18.528604 25236 tablet_bootstrap.cc:492] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345: No bootstrap required, opened a new log
I20260809 06:55:18.530575 25235 tablet_bootstrap.cc:492] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538: No bootstrap required, opened a new log
I20260809 06:55:18.530942 25235 ts_tablet_manager.cc:1397] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.005s
I20260809 06:55:18.534158 25237 tablet_bootstrap.cc:654] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:18.534580 25236 ts_tablet_manager.cc:1397] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345: Time spent bootstrapping tablet: real 0.053s user 0.007s sys 0.005s
I20260809 06:55:18.535558 25237 log.cc:824] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:18.547668 25237 tablet_bootstrap.cc:492] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a: No bootstrap required, opened a new log
I20260809 06:55:18.548094 25237 ts_tablet_manager.cc:1397] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.000s
I20260809 06:55:18.549582 25235 raft_consensus.cc:348] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18ce0e717060418a92fb446565b0528a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33403 } } peers { permanent_uuid: "6bc130a624144d6cbbcd179e26b1f538" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 42539 } } peers { permanent_uuid: "57781b3d92464a9085946c47a35b6345" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38589 } }
I20260809 06:55:18.554675 25235 raft_consensus.cc:374] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:18.554867 25235 raft_consensus.cc:729] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bc130a624144d6cbbcd179e26b1f538, State: Initialized, Role: FOLLOWER
I20260809 06:55:18.555774 25235 consensus_queue.cc:260] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18ce0e717060418a92fb446565b0528a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33403 } } peers { permanent_uuid: "6bc130a624144d6cbbcd179e26b1f538" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 42539 } } peers { permanent_uuid: "57781b3d92464a9085946c47a35b6345" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38589 } }
I20260809 06:55:18.558630 25236 raft_consensus.cc:348] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18ce0e717060418a92fb446565b0528a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33403 } } peers { permanent_uuid: "6bc130a624144d6cbbcd179e26b1f538" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 42539 } } peers { permanent_uuid: "57781b3d92464a9085946c47a35b6345" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38589 } }
I20260809 06:55:18.559165 25236 raft_consensus.cc:374] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:18.559338 25236 raft_consensus.cc:729] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57781b3d92464a9085946c47a35b6345, State: Initialized, Role: FOLLOWER
I20260809 06:55:18.560099 25236 consensus_queue.cc:260] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18ce0e717060418a92fb446565b0528a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33403 } } peers { permanent_uuid: "6bc130a624144d6cbbcd179e26b1f538" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 42539 } } peers { permanent_uuid: "57781b3d92464a9085946c47a35b6345" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38589 } }
I20260809 06:55:18.571310 25237 raft_consensus.cc:348] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18ce0e717060418a92fb446565b0528a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33403 } } peers { permanent_uuid: "6bc130a624144d6cbbcd179e26b1f538" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 42539 } } peers { permanent_uuid: "57781b3d92464a9085946c47a35b6345" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38589 } }
I20260809 06:55:18.571961 25237 raft_consensus.cc:374] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:18.572160 25237 raft_consensus.cc:729] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18ce0e717060418a92fb446565b0528a, State: Initialized, Role: FOLLOWER
I20260809 06:55:18.572783 25213 heartbeater.cc:503] Master 127.10.205.126:34127 was elected leader, sending a full tablet report...
I20260809 06:55:18.572964 25237 consensus_queue.cc:260] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18ce0e717060418a92fb446565b0528a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33403 } } peers { permanent_uuid: "6bc130a624144d6cbbcd179e26b1f538" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 42539 } } peers { permanent_uuid: "57781b3d92464a9085946c47a35b6345" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38589 } }
I20260809 06:55:18.577652 25235 ts_tablet_manager.cc:1428] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538: Time spent starting tablet: real 0.047s user 0.015s sys 0.001s
I20260809 06:55:18.582468 24925 heartbeater.cc:503] Master 127.10.205.126:34127 was elected leader, sending a full tablet report...
I20260809 06:55:18.585537 25237 ts_tablet_manager.cc:1428] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a: Time spent starting tablet: real 0.037s user 0.013s sys 0.000s
I20260809 06:55:18.585577 25242 raft_consensus.cc:482] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:55:18.586474 25242 raft_consensus.cc:504] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18ce0e717060418a92fb446565b0528a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33403 } } peers { permanent_uuid: "6bc130a624144d6cbbcd179e26b1f538" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 42539 } } peers { permanent_uuid: "57781b3d92464a9085946c47a35b6345" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38589 } }
I20260809 06:55:18.588068 25236 ts_tablet_manager.cc:1428] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345: Time spent starting tablet: real 0.053s user 0.015s sys 0.002s
I20260809 06:55:18.609612 25242 leader_election.cc:288] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18ce0e717060418a92fb446565b0528a (127.10.205.65:33403), 6bc130a624144d6cbbcd179e26b1f538 (127.10.205.67:42539)
I20260809 06:55:18.632597 25230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.595937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:48619 (local address 127.10.205.65:33403)
0809 06:55:18.596124 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:18.596130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:18.617445 (+ 21315us) server_negotiation.cc:407] Connection header received
0809 06:55:18.618020 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:18.618026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:18.618114 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:18.618189 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:18.619504 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.620620 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.628121 (+ 7501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.629361 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.629510 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.629582 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:18.632162 (+ 2580us) server_negotiation.cc:299] Negotiation successful
0809 06:55:18.632342 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:55:18.633597 25246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.595396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33403 (local address 127.10.205.66:48619)
0809 06:55:18.617288 (+ 21892us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:18.617313 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:18.617836 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:18.618395 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:18.618399 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:18.618425 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:18.618778 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:18.618790 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.621015 (+ 2225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.621022 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:18.623313 (+ 2291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:18.623329 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.629774 (+ 6445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.629780 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:18.629943 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.629977 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 06:55:18.633081 (+ 3104us) client_negotiation.cc:240] Negotiation successful
0809 06:55:18.633241 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21724,"thread_start_us":31255,"threads_started":1}
I20260809 06:55:18.634315 25232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.602545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:33057 (local address 127.10.205.67:42539)
0809 06:55:18.602787 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:18.602795 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:18.619403 (+ 16608us) server_negotiation.cc:407] Connection header received
0809 06:55:18.623529 (+ 4126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:18.623535 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:18.623617 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:18.623677 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:18.624428 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.625440 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.630217 (+ 4777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.631387 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.631519 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.631586 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:18.633929 (+ 2343us) server_negotiation.cc:299] Negotiation successful
0809 06:55:18.634078 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:55:18.635135 25245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.602859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:42539 (local address 127.10.205.66:33057)
0809 06:55:18.619293 (+ 16434us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:18.619312 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:18.620814 (+ 1502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:18.623856 (+ 3042us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:18.623861 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:18.623885 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:18.624225 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:18.624235 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.625663 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.625667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:18.627913 (+ 2246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:18.627928 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.631799 (+ 3871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.631804 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:18.631967 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.631996 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 06:55:18.634673 (+ 2677us) client_negotiation.cc:240] Negotiation successful
0809 06:55:18.634812 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16316,"thread_start_us":14620,"threads_started":1}
I20260809 06:55:18.636219 24879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4102fd4bbd44049ab92bfddda61a221" candidate_uuid: "57781b3d92464a9085946c47a35b6345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18ce0e717060418a92fb446565b0528a" is_pre_election: true
I20260809 06:55:18.636929 24879 raft_consensus.cc:2454] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57781b3d92464a9085946c47a35b6345 in term 0.
I20260809 06:55:18.637463 25167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4102fd4bbd44049ab92bfddda61a221" candidate_uuid: "57781b3d92464a9085946c47a35b6345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc130a624144d6cbbcd179e26b1f538" is_pre_election: true
I20260809 06:55:18.637794 24959 leader_election.cc:302] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18ce0e717060418a92fb446565b0528a, 57781b3d92464a9085946c47a35b6345; no voters:
I20260809 06:55:18.638002 25167 raft_consensus.cc:2454] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57781b3d92464a9085946c47a35b6345 in term 0.
I20260809 06:55:18.639734 25242 raft_consensus.cc:2781] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:55:18.639889 25242 raft_consensus.cc:482] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:55:18.639978 25242 raft_consensus.cc:3037] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:18.643198 25242 raft_consensus.cc:504] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18ce0e717060418a92fb446565b0528a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33403 } } peers { permanent_uuid: "6bc130a624144d6cbbcd179e26b1f538" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 42539 } } peers { permanent_uuid: "57781b3d92464a9085946c47a35b6345" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38589 } }
I20260809 06:55:18.644966 24879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4102fd4bbd44049ab92bfddda61a221" candidate_uuid: "57781b3d92464a9085946c47a35b6345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18ce0e717060418a92fb446565b0528a"
I20260809 06:55:18.645207 24879 raft_consensus.cc:3037] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:18.648787 24879 raft_consensus.cc:2454] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57781b3d92464a9085946c47a35b6345 in term 1.
I20260809 06:55:18.649315 24959 leader_election.cc:302] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18ce0e717060418a92fb446565b0528a, 57781b3d92464a9085946c47a35b6345; no voters:
I20260809 06:55:18.649634 25243 raft_consensus.cc:2781] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:55:18.651700 25242 leader_election.cc:288] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [CANDIDATE]: Term 1 election: Requested vote from peers 18ce0e717060418a92fb446565b0528a (127.10.205.65:33403), 6bc130a624144d6cbbcd179e26b1f538 (127.10.205.67:42539)
I20260809 06:55:18.652464 25167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4102fd4bbd44049ab92bfddda61a221" candidate_uuid: "57781b3d92464a9085946c47a35b6345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bc130a624144d6cbbcd179e26b1f538"
I20260809 06:55:18.652707 25167 raft_consensus.cc:3037] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:18.656201 25167 raft_consensus.cc:2454] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57781b3d92464a9085946c47a35b6345 in term 1.
I20260809 06:55:18.657961 25243 raft_consensus.cc:686] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 1 LEADER]: Becoming Leader. State: Replica: 57781b3d92464a9085946c47a35b6345, State: Running, Role: LEADER
I20260809 06:55:18.658689 25243 consensus_queue.cc:237] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18ce0e717060418a92fb446565b0528a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33403 } } peers { permanent_uuid: "6bc130a624144d6cbbcd179e26b1f538" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 42539 } } peers { permanent_uuid: "57781b3d92464a9085946c47a35b6345" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38589 } }
I20260809 06:55:18.671028 24720 catalog_manager.cc:5495] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57781b3d92464a9085946c47a35b6345 (127.10.205.66). New cstate: current_term: 1 leader_uuid: "57781b3d92464a9085946c47a35b6345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18ce0e717060418a92fb446565b0528a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc130a624144d6cbbcd179e26b1f538" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 42539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57781b3d92464a9085946c47a35b6345" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38589 } health_report { overall_health: HEALTHY } } }
W20260809 06:55:18.686702 25214 tablet.cc:2369] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:55:18.714404 25234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.705278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38492 (local address 127.10.205.66:38589)
0809 06:55:18.705556 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:18.705564 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:18.705590 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:55:18.705714 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:18.705721 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:18.705861 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:18.706062 (+ 201us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:55:18.706562 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.707689 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.710455 (+ 2766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.711131 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.711267 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.712040 (+ 773us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:55:18.713172 (+ 1132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:55:18.713327 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:18.713997 (+ 670us) server_negotiation.cc:299] Negotiation successful
0809 06:55:18.714088 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 06:55:18.724781 25167 raft_consensus.cc:1261] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538 [term 1 FOLLOWER]: Refusing update from remote peer 57781b3d92464a9085946c47a35b6345: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:55:18.724807 24879 raft_consensus.cc:1261] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a [term 1 FOLLOWER]: Refusing update from remote peer 57781b3d92464a9085946c47a35b6345: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:55:18.725904 25242 consensus_queue.cc:1035] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18ce0e717060418a92fb446565b0528a" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:55:18.726368 25243 consensus_queue.cc:1035] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bc130a624144d6cbbcd179e26b1f538" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 42539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 06:55:18.731235 25076 tablet.cc:2369] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:55:18.752739 25259 mvcc.cc:205] Tried to move back new op lower bound from 7316514892684750848 to 7316514892432773120. Current Snapshot: MvccSnapshot[applied={T|T < 7316514892684750848}]
I20260809 06:55:18.755496 25261 mvcc.cc:205] Tried to move back new op lower bound from 7316514892684750848 to 7316514892432773120. Current Snapshot: MvccSnapshot[applied={T|T < 7316514892684750848}]
I20260809 06:55:18.767539 25260 mvcc.cc:205] Tried to move back new op lower bound from 7316514892684750848 to 7316514892432773120. Current Snapshot: MvccSnapshot[applied={T|T < 7316514892684750848}]
I20260809 06:55:18.803079 24720 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42948:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:55:18.803385 24720 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42948:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:55:18.807803 24720 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4fe47b47dd72498a804d67dd3356b49c: Sending DeleteTablet for 3 replicas of tablet f4102fd4bbd44049ab92bfddda61a221
I20260809 06:55:18.809140 25146 tablet_service.cc:1514] Processing DeleteTablet for tablet f4102fd4bbd44049ab92bfddda61a221 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:55:18 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:37538
I20260809 06:55:18.810031 24859 tablet_service.cc:1514] Processing DeleteTablet for tablet f4102fd4bbd44049ab92bfddda61a221 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:55:18 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:38894
I20260809 06:55:18.810410 25006 tablet_service.cc:1514] Processing DeleteTablet for tablet f4102fd4bbd44049ab92bfddda61a221 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:55:18 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:38482
I20260809 06:55:18.811400 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 24760
I20260809 06:55:18.839633 25269 tablet_replica.cc:330] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a: stopping tablet replica
I20260809 06:55:18.842566 25269 raft_consensus.cc:2229] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:55:18.843788 25269 raft_consensus.cc:2258] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:55:18.845822 25268 tablet_replica.cc:330] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538: stopping tablet replica
I20260809 06:55:18.849946 25268 raft_consensus.cc:2229] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:55:18.850548 25268 raft_consensus.cc:2258] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:55:18.851378 25269 ts_tablet_manager.cc:1905] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:55:18.855878 25268 ts_tablet_manager.cc:1905] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:55:18.860526 25270 tablet_replica.cc:330] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345: stopping tablet replica
I20260809 06:55:18.861131 25270 raft_consensus.cc:2229] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:55:18.862325 25270 raft_consensus.cc:2258] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:55:18.864940 25269 ts_tablet_manager.cc:1918] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:55:18.865163 25269 log.cc:1196] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/f4102fd4bbd44049ab92bfddda61a221
I20260809 06:55:18.865772 25269 ts_tablet_manager.cc:1939] T f4102fd4bbd44049ab92bfddda61a221 P 18ce0e717060418a92fb446565b0528a: Deleting consensus metadata
I20260809 06:55:18.867558 25270 ts_tablet_manager.cc:1905] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:55:18.867908 24705 catalog_manager.cc:4841] TS 18ce0e717060418a92fb446565b0528a (127.10.205.65:33403): tablet f4102fd4bbd44049ab92bfddda61a221 (table test-table [id=f7fe0cabf2874d5faaa3cbe7ddbb6712]) successfully deleted
I20260809 06:55:18.871623 25230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:18.812835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38902 (local address 127.10.205.65:33403)
0809 06:55:18.813004 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:18.813010 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:18.836318 (+ 23308us) server_negotiation.cc:407] Connection header received
0809 06:55:18.836903 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:18.836910 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:18.836999 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:18.837075 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:18.839905 (+ 2830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.841101 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.847891 (+ 6790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:18.848571 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:18.848689 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:18.859268 (+ 10579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:18.859289 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:18.859307 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:18.859353 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:18.863554 (+ 4201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:18.868666 (+ 5112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:18.868676 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:18.868680 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:18.868869 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:18.869409 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:18.869415 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:18.869418 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:18.869917 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:18.870263 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:18.870928 (+ 665us) server_negotiation.cc:299] Negotiation successful
0809 06:55:18.871215 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:55:18.873131 24920 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:18.876829 25270 ts_tablet_manager.cc:1918] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:55:18.877094 25270 log.cc:1196] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/f4102fd4bbd44049ab92bfddda61a221
I20260809 06:55:18.877792 25270 ts_tablet_manager.cc:1939] T f4102fd4bbd44049ab92bfddda61a221 P 57781b3d92464a9085946c47a35b6345: Deleting consensus metadata
I20260809 06:55:18.880316 24706 catalog_manager.cc:4841] TS 57781b3d92464a9085946c47a35b6345 (127.10.205.66:38589): tablet f4102fd4bbd44049ab92bfddda61a221 (table test-table [id=f7fe0cabf2874d5faaa3cbe7ddbb6712]) successfully deleted
I20260809 06:55:18.882927 25268 ts_tablet_manager.cc:1918] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:55:18.883240 25268 log.cc:1196] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/f4102fd4bbd44049ab92bfddda61a221
I20260809 06:55:18.883957 25268 ts_tablet_manager.cc:1939] T f4102fd4bbd44049ab92bfddda61a221 P 6bc130a624144d6cbbcd179e26b1f538: Deleting consensus metadata
I20260809 06:55:18.885947 24707 catalog_manager.cc:4841] TS 6bc130a624144d6cbbcd179e26b1f538 (127.10.205.67:42539): tablet f4102fd4bbd44049ab92bfddda61a221 (table test-table [id=f7fe0cabf2874d5faaa3cbe7ddbb6712]) successfully deleted
I20260809 06:55:19.039166 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 24760
I20260809 06:55:19.066955 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 24929
I20260809 06:55:19.083029 25234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:19.067835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38508 (local address 127.10.205.66:38589)
0809 06:55:19.068074 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:19.068080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:19.068189 (+ 109us) server_negotiation.cc:407] Connection header received
0809 06:55:19.068464 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:19.068471 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:19.068562 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:19.068688 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:19.070073 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:19.071365 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:19.072878 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:19.073581 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:19.073729 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:19.076444 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:19.076459 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:19.076473 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:19.076513 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:19.079840 (+ 3327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:19.080738 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:19.080745 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:19.080748 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:19.080902 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:19.081336 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:19.081340 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:19.081342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:19.081763 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:19.082131 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:19.082425 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 06:55:19.082670 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 06:55:19.083912 25070 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:19.205090 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 24929
I20260809 06:55:19.229540 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 25079
I20260809 06:55:19.243834 25274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:19.230314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37548 (local address 127.10.205.67:42539)
0809 06:55:19.230862 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:19.230867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:19.230884 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:55:19.230943 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:19.230946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:19.231012 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:19.231106 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:19.232465 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:19.233263 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:19.234517 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:19.234939 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:19.235030 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:19.237836 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:19.237854 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:19.237870 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:19.237906 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:19.241088 (+ 3182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:19.241830 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:19.241838 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:19.241840 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:19.241974 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:19.242369 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:19.242372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:19.242374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:19.242792 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:19.243026 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:19.243372 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 06:55:19.243559 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":304,"threads_started":1}
I20260809 06:55:19.244541 25208 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:19.337610 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 25079
I20260809 06:55:19.358698 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 24686
I20260809 06:55:19.359930 24752 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:19.476835 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 24686
I20260809 06:55:19.506747 11061 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 06:55:19.853740 11061 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 06:55:19.853999 11061 mini_ranger.cc:66] Stopping Ranger...
I20260809 06:55:20.200927 11061 mini_ranger.cc:68] Stopped Ranger
2026-08-09 06:55:20.201 UTC [23704] LOG: received smart shutdown request
2026-08-09 06:55:20.204 UTC [23704] LOG: background worker "logical replication launcher" (PID 23714) exited with exit code 1
2026-08-09 06:55:20.204 UTC [23708] LOG: shutting down
2026-08-09 06:55:20.370 UTC [23704] LOG: database system is shut down
2026-08-09T06:55:20Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (54780 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:55:20 dist-test-slave-0b58 krb5kdc[25285](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:55:20 dist-test-slave-0b58 krb5kdc[25285](info): set up 2 sockets
Aug 09 06:55:20 dist-test-slave-0b58 krb5kdc[25285](info): commencing operation
krb5kdc: starting...
W20260809 06:55:21.663532 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.002s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:55:21 dist-test-slave-0b58 krb5kdc[25285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:55:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:55:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:55:21.951658 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:42767
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:42767,127.10.205.125:36553,127.10.205.124:45965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:22.299219 25299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:22.299593 25299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:22.299767 25299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:22.307263 25299 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:55:22.307410 25299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:22.307531 25299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:22.307636 25299 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:55:22.307729 25299 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:55:22.318006 25299 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:42767,127.10.205.125:36553,127.10.205.124:45965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:42767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:22.319444 25299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:22.320863 25299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:22.333745 25304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:22.333637 25305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:22.333710 25307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:22.334517 25299 server_base.cc:1034] running on GCE node
I20260809 06:55:22.335458 25299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:22.336962 25299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:22.338302 25299 hybrid_clock.cc:648] HybridClock initialized: now 1786258522338256 us; error 51 us; skew 500 ppm
I20260809 06:55:22.338694 25299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:22 dist-test-slave-0b58 krb5kdc[25285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258522, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:22.342036 25299 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:55:22.343467 25299 webserver.cc:460] Webserver started at http://127.10.205.126:35033/ using document root <none> and password file <none>
I20260809 06:55:22.344161 25299 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:22.344312 25299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:22.344609 25299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:55:22.347589 25299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "244e15013630402c8e0fa8c6bd653ebd"
format_stamp: "Formatted at 2026-08-09 06:55:22 on dist-test-slave-0b58"
server_key: "9460d76056f6bffd3d1f5de20224806c"
server_key_iv: "748e1413049d356b54069fae42ff35d2"
server_key_version: "encryptionkey@0"
I20260809 06:55:22.348446 25299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "244e15013630402c8e0fa8c6bd653ebd"
format_stamp: "Formatted at 2026-08-09 06:55:22 on dist-test-slave-0b58"
server_key: "9460d76056f6bffd3d1f5de20224806c"
server_key_iv: "748e1413049d356b54069fae42ff35d2"
server_key_version: "encryptionkey@0"
I20260809 06:55:22.353597 25299 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 06:55:22.357214 25314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:22.358569 25299 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:55:22.358711 25299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "244e15013630402c8e0fa8c6bd653ebd"
format_stamp: "Formatted at 2026-08-09 06:55:22 on dist-test-slave-0b58"
server_key: "9460d76056f6bffd3d1f5de20224806c"
server_key_iv: "748e1413049d356b54069fae42ff35d2"
server_key_version: "encryptionkey@0"
I20260809 06:55:22.358886 25299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:22.386978 25299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:22.391086 25299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:22.391402 25299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:22.411574 25299 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:42767
I20260809 06:55:22.411608 25367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:42767 every 8 connection(s)
I20260809 06:55:22.413110 25299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:55:22.417002 25368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:22.420652 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 25299
I20260809 06:55:22.420919 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:55:22.421833 11061 external_mini_cluster.cc:1428] Setting key be4afd4a7cdc95d7173577c8280eaa46
I20260809 06:55:22.426294 25368 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:55:22 dist-test-slave-0b58 krb5kdc[25285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258522, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.205.125@KRBTEST.COM; defaulting to no policy
I20260809 06:55:22.453469 25371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.430369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60824 (local address 127.10.205.126:42767)
0809 06:55:22.432417 (+ 2048us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:22.432423 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:22.432468 (+ 45us) server_negotiation.cc:407] Connection header received
0809 06:55:22.434447 (+ 1979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:22.434459 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:22.434808 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:22.435034 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:22.436222 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:22.438287 (+ 2065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:22.439707 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:22.440747 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:22.441018 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:22.444741 (+ 3723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:22.444759 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:22.444781 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:22.444830 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:22.449082 (+ 4252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:22.449790 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:22.449800 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:22.449804 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:22.450009 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:22.450421 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:22.450426 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:22.450430 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:22.451221 (+ 791us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:22.451475 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:22.451964 (+ 489us) server_negotiation.cc:299] Negotiation successful
0809 06:55:22.452435 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":150,"server-negotiator.queue_time_us":1831,"spinlock_wait_cycles":17280,"thread_start_us":1579,"threads_started":1}
I20260809 06:55:22.453507 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.430369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:42767 (local address 127.0.0.1:60824)
0809 06:55:22.431396 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:22.431460 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:22.434033 (+ 2573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:22.435066 (+ 1033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:22.435071 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:22.435669 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:22.436016 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:22.436033 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:22.438464 (+ 2431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:22.438468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:22.439552 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:22.439565 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:22.441017 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:22.441022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:22.441139 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:22.441853 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:22.441900 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:22.444476 (+ 2576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:22.449225 (+ 4749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:22.449236 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:22.449247 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:22.449644 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:22.450142 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:22.450146 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:22.450148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:22.450297 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:22.451368 (+ 1071us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:22.451374 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:22.451565 (+ 191us) client_negotiation.cc:769] Sending connection context
0809 06:55:22.451775 (+ 210us) client_negotiation.cc:240] Negotiation successful
0809 06:55:22.452316 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"thread_start_us":447,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.125@KRBTEST.COM" created.
I20260809 06:55:22.456775 25368 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:55:22.458001 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.457464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60896)
0809 06:55:22.457685 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:22.457834 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260809 06:55:22.458298 25317 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
I20260809 06:55:22.460094 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.459632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60902)
0809 06:55:22.459811 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:22.459918 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 06:55:22.460350 25368 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:36553: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.125.keytab.
Entry for principal kudu/127.10.205.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.125.keytab.
I20260809 06:55:22.488202 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.125:36553
--webserver_interface=127.10.205.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.125.keytab
--principal=kudu/127.10.205.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:42767,127.10.205.125:36553,127.10.205.124:45965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:55:22.509704 25368 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } attempt: 1
I20260809 06:55:22.510931 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.510424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60906)
0809 06:55:22.510634 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:22.510750 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 06:55:22.512087 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.511718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60918)
0809 06:55:22.511883 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:22.511954 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 06:55:22.512313 25368 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:36553: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
I20260809 06:55:22.580583 25368 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } attempt: 2
I20260809 06:55:22.581856 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.581320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60926)
0809 06:55:22.581598 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:22.581689 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 06:55:22.582916 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.582533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60930)
0809 06:55:22.582686 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:22.582777 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 06:55:22.583113 25368 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:36553: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
I20260809 06:55:22.674374 25368 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } attempt: 3
I20260809 06:55:22.675567 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.675103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60932)
0809 06:55:22.675322 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:22.675428 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 06:55:22.676748 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.676356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60940)
0809 06:55:22.676508 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:22.676604 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 06:55:22.676936 25368 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:36553: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
I20260809 06:55:22.820354 25368 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } attempt: 4
I20260809 06:55:22.821727 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.821051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60954)
0809 06:55:22.821426 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:22.821544 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
I20260809 06:55:22.822875 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.822442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60968)
0809 06:55:22.822601 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:22.822712 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 06:55:22.823067 25368 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:36553: Network error: Client connection negotiation failed: client connection to 127.10.205.125:36553: connect: Connection refused (error 111)
W20260809 06:55:22.833014 25376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:22.833333 25376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:22.833541 25376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:22.841022 25376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:55:22.841140 25376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:22.841272 25376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:22.841377 25376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:55:22.841459 25376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:55:22.851734 25376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:42767,127.10.205.125:36553,127.10.205.124:45965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.125.keytab
--principal=kudu/127.10.205.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.125:36553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.205.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:22.853250 25376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:22.854662 25376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:22.867455 25382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:22.867503 25384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:22.867527 25381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:22.868350 25376 server_base.cc:1034] running on GCE node
I20260809 06:55:22.869189 25376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:22.870632 25376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:22.871846 25376 hybrid_clock.cc:648] HybridClock initialized: now 1786258522871806 us; error 37 us; skew 500 ppm
I20260809 06:55:22.872217 25376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:22 dist-test-slave-0b58 krb5kdc[25285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258522, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:22.875694 25376 init.cc:377] Logged in from keytab as kudu/127.10.205.125@KRBTEST.COM (short username kudu)
I20260809 06:55:22.877310 25376 webserver.cc:460] Webserver started at http://127.10.205.125:45537/ using document root <none> and password file <none>
I20260809 06:55:22.878119 25376 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:22.878260 25376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:22.878588 25376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:55:22.881747 25376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/data/instance:
uuid: "97ec2fd366f44121863a3a9472242b4b"
format_stamp: "Formatted at 2026-08-09 06:55:22 on dist-test-slave-0b58"
server_key: "16a508d968a499c8eb6a7b6b4ae4f890"
server_key_iv: "8b475df3dc7d684923263b4a96759cea"
server_key_version: "encryptionkey@0"
I20260809 06:55:22.882639 25376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/wal/instance:
uuid: "97ec2fd366f44121863a3a9472242b4b"
format_stamp: "Formatted at 2026-08-09 06:55:22 on dist-test-slave-0b58"
server_key: "16a508d968a499c8eb6a7b6b4ae4f890"
server_key_iv: "8b475df3dc7d684923263b4a96759cea"
server_key_version: "encryptionkey@0"
I20260809 06:55:22.888031 25376 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 06:55:22.891408 25392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:22.892881 25376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:55:22.893177 25376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/wal
uuid: "97ec2fd366f44121863a3a9472242b4b"
format_stamp: "Formatted at 2026-08-09 06:55:22 on dist-test-slave-0b58"
server_key: "16a508d968a499c8eb6a7b6b4ae4f890"
server_key_iv: "8b475df3dc7d684923263b4a96759cea"
server_key_version: "encryptionkey@0"
I20260809 06:55:22.893414 25376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:22.951713 25376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:22.957304 25376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:22.957684 25376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:22.977988 25376 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.125:36553
I20260809 06:55:22.978011 25446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.125:36553 every 8 connection(s)
I20260809 06:55:22.979488 25376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
I20260809 06:55:22.983372 25448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:22.987695 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 25376
I20260809 06:55:22.987931 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-1/wal/instance
I20260809 06:55:22.988548 11061 external_mini_cluster.cc:1428] Setting key 3c8f22f3428eb3e2c140514160ced2ba
I20260809 06:55:22.991768 25448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:55:23 dist-test-slave-0b58 krb5kdc[25285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258522, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.125@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:23.015543 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.995526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60832 (local address 127.10.205.126:42767)
0809 06:55:22.996101 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:22.996108 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:22.997347 (+ 1239us) server_negotiation.cc:407] Connection header received
0809 06:55:23.000501 (+ 3154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.000507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.000599 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.000742 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.002448 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.003164 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.004862 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.005277 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.005420 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.009285 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.009291 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.009295 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.009342 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.012221 (+ 2879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.013079 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.013086 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.013095 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.013220 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.013668 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.013672 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.013674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.013974 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.014143 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.014928 (+ 785us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.015165 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":291,"threads_started":1}
WARNING: no policy specified for kudu/127.10.205.124@KRBTEST.COM; defaulting to no policy
I20260809 06:55:23.016676 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:22.996099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:42767 (local address 127.0.0.1:60832)
0809 06:55:22.997139 (+ 1040us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:22.997193 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:23.000098 (+ 2905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:23.001034 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:23.001044 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:23.001627 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:23.002234 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.002253 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.003351 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.003354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.004700 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.004714 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.005526 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.005534 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.005764 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.006511 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:23.006536 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:23.009025 (+ 2489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:23.012433 (+ 3408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.012442 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.012460 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.012942 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.013342 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.013347 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.013350 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.013536 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.014130 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:23.014139 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:23.014529 (+ 390us) client_negotiation.cc:769] Sending connection context
0809 06:55:23.014808 (+ 279us) client_negotiation.cc:240] Negotiation successful
0809 06:55:23.015356 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":431,"threads_started":1}
I20260809 06:55:23.018570 25448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.124@KRBTEST.COM" created.
Aug 09 06:55:23 dist-test-slave-0b58 krb5kdc[25285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258522, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.125@KRBTEST.COM for kudu/127.10.205.125@KRBTEST.COM
I20260809 06:55:23.036187 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.019607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60970 (local address 127.10.205.125:36553)
0809 06:55:23.020332 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.020339 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.020376 (+ 37us) server_negotiation.cc:407] Connection header received
0809 06:55:23.020422 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.020428 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.020610 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.020721 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.021760 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.022832 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.024675 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.025242 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.025354 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.029794 (+ 4440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.029809 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.029825 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.029858 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.032960 (+ 3102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.033817 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.033825 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.033827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.033977 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.034455 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.034458 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.034460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.034849 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.035025 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.035460 (+ 435us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.035844 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":163,"server-negotiator.queue_time_us":505,"thread_start_us":339,"threads_started":1}
I20260809 06:55:23.036237 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.019566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60970)
0809 06:55:23.019818 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.019841 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:23.019971 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:23.020776 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:23.020784 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:23.021356 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:23.021587 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.021603 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.022987 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.022995 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.024529 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.024547 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.025433 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.025445 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.025730 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.026426 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:23.026455 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:23.029530 (+ 3075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:23.033109 (+ 3579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.033117 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.033124 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.033682 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.034089 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.034096 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.034102 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.034337 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.034996 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:23.035004 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:23.035186 (+ 182us) client_negotiation.cc:769] Sending connection context
0809 06:55:23.035347 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 06:55:23.035716 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 06:55:23.039093 25448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:55:23.040371 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.039753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:50990)
0809 06:55:23.039965 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.040121 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260809 06:55:23.040654 25395 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
I20260809 06:55:23.042436 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.041981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51006)
0809 06:55:23.042185 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.042288 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260809 06:55:23.042682 25448 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:45965: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.124.keytab.
Entry for principal kudu/127.10.205.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.124.keytab.
I20260809 06:55:23.056043 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.124:45965
--webserver_interface=127.10.205.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.124.keytab
--principal=kudu/127.10.205.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:42767,127.10.205.125:36553,127.10.205.124:45965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:55:23.092088 25448 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } attempt: 1
I20260809 06:55:23.093510 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.092893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51012)
0809 06:55:23.093131 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.093278 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260809 06:55:23.094595 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.094176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51022)
0809 06:55:23.094387 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.094471 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260809 06:55:23.094873 25448 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:45965: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
I20260809 06:55:23.122412 25368 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } attempt: 5
Aug 09 06:55:23 dist-test-slave-0b58 krb5kdc[25285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258522, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for kudu/127.10.205.125@KRBTEST.COM
I20260809 06:55:23.137863 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.123238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60982)
0809 06:55:23.123481 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.123506 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:23.123657 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:23.124145 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:23.124148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:23.124621 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:23.124809 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.124818 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.126284 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.126288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.127159 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.127169 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.128177 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.128181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.128427 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.129136 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:23.129154 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:23.131402 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:23.135340 (+ 3938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.135344 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.135347 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.135747 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.136162 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.136166 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.136168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.136380 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.137005 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:23.137008 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:23.137157 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 06:55:23.137263 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 06:55:23.137530 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86}
I20260809 06:55:23.138002 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.123517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60982 (local address 127.10.205.125:36553)
0809 06:55:23.123777 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.123783 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.123810 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:55:23.123898 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.123905 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.123987 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.124107 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.125000 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.126100 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.127327 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.128025 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.128161 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.131614 (+ 3453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.131620 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.131625 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.131678 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.135160 (+ 3482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.135876 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.135883 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.135886 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.136045 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.136492 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.136497 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.136500 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.136893 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.137051 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.137421 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.137694 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 06:55:23.139192 25368 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:55:23.140358 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.139919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51032)
0809 06:55:23.140096 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.140171 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 06:55:23.141399 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.141065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51034)
0809 06:55:23.141205 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.141288 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 06:55:23.141700 25368 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:45965: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
I20260809 06:55:23.163102 25448 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } attempt: 2
I20260809 06:55:23.164528 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.163866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51044)
0809 06:55:23.164095 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.164244 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 06:55:23.165633 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.165256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51058)
0809 06:55:23.165415 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.165506 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 06:55:23.165848 25448 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:45965: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
I20260809 06:55:23.192960 25368 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } attempt: 1
I20260809 06:55:23.194332 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.193811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51074)
0809 06:55:23.194037 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.194136 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260809 06:55:23.195466 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.195099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51086)
0809 06:55:23.195259 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.195345 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 06:55:23.195693 25368 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:45965: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
I20260809 06:55:23.257120 25448 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } attempt: 3
I20260809 06:55:23.258605 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.257945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51100)
0809 06:55:23.258255 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.258376 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260809 06:55:23.259881 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.259382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51108)
0809 06:55:23.259639 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.259735 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
W20260809 06:55:23.260125 25448 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:45965: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
I20260809 06:55:23.263888 25368 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } attempt: 2
I20260809 06:55:23.264989 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.264517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51114)
0809 06:55:23.264743 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.264823 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 06:55:23.265977 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.265631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51128)
0809 06:55:23.265783 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.265864 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 06:55:23.266242 25368 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:45965: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
I20260809 06:55:23.372529 25368 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } attempt: 3
I20260809 06:55:23.373713 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.373221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51136)
0809 06:55:23.373430 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.373532 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 06:55:23.374820 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.374424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51148)
0809 06:55:23.374637 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.374722 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260809 06:55:23.375115 25368 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:45965: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
I20260809 06:55:23.403383 25448 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } attempt: 4
I20260809 06:55:23.404608 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.404012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51162)
0809 06:55:23.404283 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.404399 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 06:55:23.406014 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.405541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51176)
0809 06:55:23.405782 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.405877 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
W20260809 06:55:23.406369 25448 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:45965: Network error: Client connection negotiation failed: client connection to 127.10.205.124:45965: connect: Connection refused (error 111)
W20260809 06:55:23.415050 25456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:23.415376 25456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:23.415561 25456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:23.423064 25456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:55:23.423226 25456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:23.423331 25456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:23.423436 25456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:55:23.423524 25456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:55:23.434111 25456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:42767,127.10.205.125:36553,127.10.205.124:45965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.124.keytab
--principal=kudu/127.10.205.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.124:45965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.205.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:23.435581 25456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:23.436998 25456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:23.449106 25461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:23.449132 25462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:23.449189 25464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:23.450129 25456 server_base.cc:1034] running on GCE node
I20260809 06:55:23.450917 25456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:23.452421 25456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:23.453631 25456 hybrid_clock.cc:648] HybridClock initialized: now 1786258523453590 us; error 48 us; skew 500 ppm
I20260809 06:55:23.453999 25456 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:23 dist-test-slave-0b58 krb5kdc[25285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258523, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:23.457291 25456 init.cc:377] Logged in from keytab as kudu/127.10.205.124@KRBTEST.COM (short username kudu)
I20260809 06:55:23.458865 25456 webserver.cc:460] Webserver started at http://127.10.205.124:37235/ using document root <none> and password file <none>
I20260809 06:55:23.459591 25456 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:23.459758 25456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:23.460124 25456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:55:23.463550 25456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/data/instance:
uuid: "fbfe1ade436f4ee6981dba2a24f108cb"
format_stamp: "Formatted at 2026-08-09 06:55:23 on dist-test-slave-0b58"
server_key: "202b9ff4736c82392eda3cf6617beb9d"
server_key_iv: "e0ab5d0b1868a62668d4bf7ddaef989b"
server_key_version: "encryptionkey@0"
I20260809 06:55:23.464432 25456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/wal/instance:
uuid: "fbfe1ade436f4ee6981dba2a24f108cb"
format_stamp: "Formatted at 2026-08-09 06:55:23 on dist-test-slave-0b58"
server_key: "202b9ff4736c82392eda3cf6617beb9d"
server_key_iv: "e0ab5d0b1868a62668d4bf7ddaef989b"
server_key_version: "encryptionkey@0"
I20260809 06:55:23.470073 25456 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260809 06:55:23.473476 25471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:23.474869 25456 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:55:23.475008 25456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/wal
uuid: "fbfe1ade436f4ee6981dba2a24f108cb"
format_stamp: "Formatted at 2026-08-09 06:55:23 on dist-test-slave-0b58"
server_key: "202b9ff4736c82392eda3cf6617beb9d"
server_key_iv: "e0ab5d0b1868a62668d4bf7ddaef989b"
server_key_version: "encryptionkey@0"
I20260809 06:55:23.475178 25456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:23.509593 25456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:23.514431 25456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:23.514683 25456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:23.534413 25456 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.124:45965
I20260809 06:55:23.534452 25523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.124:45965 every 8 connection(s)
I20260809 06:55:23.535979 25456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
I20260809 06:55:23.539893 25525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:23.545543 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 25456
I20260809 06:55:23.545766 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786258311159624-11061-0/minicluster-data/master-2/wal/instance
I20260809 06:55:23.546249 11061 external_mini_cluster.cc:1428] Setting key 0a01b5de5946a81304f016dc4b51c1b7
I20260809 06:55:23.546586 25525 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:55:23.552343 25368 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } attempt: 4
Aug 09 06:55:23 dist-test-slave-0b58 krb5kdc[25285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258523, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.124@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
Aug 09 06:55:23 dist-test-slave-0b58 krb5kdc[25285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258522, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for kudu/127.10.205.124@KRBTEST.COM
Aug 09 06:55:23 dist-test-slave-0b58 krb5kdc[25285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.124@KRBTEST.COM
I20260809 06:55:23.569800 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.549626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60844 (local address 127.10.205.126:42767)
0809 06:55:23.550235 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.550244 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.550842 (+ 598us) server_negotiation.cc:407] Connection header received
0809 06:55:23.551640 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.551648 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.551742 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.551871 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.553753 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.554731 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.556842 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.557544 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.557678 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.561890 (+ 4212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.561897 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.561904 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.561967 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.565573 (+ 3606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.566616 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.566624 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.566629 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.566800 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.567453 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.567459 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.567463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.567990 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.568149 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.569089 (+ 940us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.569342 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":309,"threads_started":1}
I20260809 06:55:23.570173 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.552951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51190)
0809 06:55:23.553244 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.553267 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:23.553385 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:23.554322 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:23.554327 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:23.554858 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:23.555022 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.555030 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.556549 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.556554 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.557816 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.557834 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.558811 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.558820 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.559047 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.559704 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:23.559730 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:23.562830 (+ 3100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:23.567398 (+ 4568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.567404 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.567408 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.567815 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.568329 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.568337 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.568343 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.568507 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.569195 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:23.569199 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:23.569391 (+ 192us) client_negotiation.cc:769] Sending connection context
0809 06:55:23.569541 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 06:55:23.569805 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151}
I20260809 06:55:23.571059 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.549560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:42767 (local address 127.0.0.1:60844)
0809 06:55:23.550651 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.550718 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:23.551389 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:23.551951 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:23.551958 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:23.552890 (+ 932us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:23.553492 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.553525 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.554918 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.554923 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.556696 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.556710 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.557772 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.557779 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.558149 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.559043 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:23.559075 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:23.561642 (+ 2567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:23.565724 (+ 4082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.565735 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.565753 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.566436 (+ 683us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.566940 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.566946 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.566952 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.567277 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.568144 (+ 867us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:23.568153 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:23.568632 (+ 479us) client_negotiation.cc:769] Sending connection context
0809 06:55:23.568958 (+ 326us) client_negotiation.cc:240] Negotiation successful
0809 06:55:23.569502 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"mutex_wait_us":30,"thread_start_us":663,"threads_started":1}
I20260809 06:55:23.571151 25531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.552968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51190 (local address 127.10.205.124:45965)
0809 06:55:23.553984 (+ 1016us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.553991 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.554022 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:55:23.554074 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.554080 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.554155 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.554270 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.555201 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.556383 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.557958 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.558662 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.558758 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.563100 (+ 4342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.563112 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.563131 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.563169 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.567246 (+ 4077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.567958 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.567966 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.567968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.568156 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.568630 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.568634 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.568637 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.569056 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.570335 (+ 1279us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.570510 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.570741 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":893,"thread_start_us":707,"threads_started":1}
I20260809 06:55:23.572471 25528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.548243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51188 (local address 127.10.205.124:45965)
0809 06:55:23.549098 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.549108 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.549146 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:55:23.551368 (+ 2222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.551390 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.551690 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.551926 (+ 236us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.553918 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.555669 (+ 1751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.557487 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.558301 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.558456 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.564434 (+ 5978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.564444 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.564452 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.564492 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.568265 (+ 3773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.569181 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.569186 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.569189 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.569319 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.569803 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.569807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.569810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.570177 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.570481 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.571703 (+ 1222us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.571904 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":77,"server-negotiator.queue_time_us":616,"spinlock_wait_cycles":30592,"thread_start_us":376,"threads_started":1}
I20260809 06:55:23.573107 25525 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:55:23.579698 25368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd: Bootstrap starting.
Aug 09 06:55:23 dist-test-slave-0b58 krb5kdc[25285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258523, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.124@KRBTEST.COM for kudu/127.10.205.125@KRBTEST.COM
I20260809 06:55:23.584340 25368 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd: Neither blocks nor log segments found. Creating new log.
Aug 09 06:55:23 dist-test-slave-0b58 krb5kdc[25285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:23.585618 25368 log.cc:824] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:23.589020 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.574044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:36553 (local address 127.0.0.1:60990)
0809 06:55:23.574222 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.574241 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:23.574363 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:23.574684 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:23.574689 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:23.575152 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:23.575397 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.575410 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.576809 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.576815 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.578168 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.578184 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.578953 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.578959 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.579163 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.579806 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:23.579824 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:23.582236 (+ 2412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:23.585882 (+ 3646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.585888 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.585891 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.586515 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.587005 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.587011 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.587014 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.587192 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.587933 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:23.587938 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:23.588128 (+ 190us) client_negotiation.cc:769] Sending connection context
0809 06:55:23.588339 (+ 211us) client_negotiation.cc:240] Negotiation successful
0809 06:55:23.588674 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 06:55:23.589133 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.573945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60990 (local address 127.10.205.125:36553)
0809 06:55:23.574172 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.574178 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.574318 (+ 140us) server_negotiation.cc:407] Connection header received
0809 06:55:23.574479 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.574483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.574547 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.574658 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.575597 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.576646 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.578332 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.578804 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.578941 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.582442 (+ 3501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.582447 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.582450 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.582485 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.585689 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.586659 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.586667 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.586673 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.586850 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.587346 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.587351 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.587355 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.587785 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.587955 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.588466 (+ 511us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.588736 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:55:23.589351 25368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd: No bootstrap required, opened a new log
I20260809 06:55:23.590525 25525 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:55:23.593441 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.575411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60846 (local address 127.10.205.126:42767)
0809 06:55:23.575592 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.575599 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.575739 (+ 140us) server_negotiation.cc:407] Connection header received
0809 06:55:23.575912 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.575917 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.576015 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.576112 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.577484 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.578221 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.580154 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.580845 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.581012 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.586564 (+ 5552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.586573 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.586581 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.586630 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.590376 (+ 3746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.591160 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.591167 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.591171 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.591307 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.591718 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.591723 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.591727 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.592010 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.592358 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.592726 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.592980 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
Aug 09 06:55:23 dist-test-slave-0b58 krb5kdc[25285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258523, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.124@KRBTEST.COM for kudu/127.10.205.124@KRBTEST.COM
I20260809 06:55:23.601735 25368 raft_consensus.cc:348] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } }
I20260809 06:55:23.602195 25368 raft_consensus.cc:374] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:23.602360 25368 raft_consensus.cc:729] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244e15013630402c8e0fa8c6bd653ebd, State: Initialized, Role: FOLLOWER
I20260809 06:55:23.603004 25368 consensus_queue.cc:260] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } }
I20260809 06:55:23.604033 25533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } } }
I20260809 06:55:23.604619 25533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [sys.catalog]: This master's current role is: FOLLOWER
Aug 09 06:55:23 dist-test-slave-0b58 krb5kdc[25285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.125@KRBTEST.COM
I20260809 06:55:23.605657 25368 sys_catalog.cc:564] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:55:23.607112 25531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.591496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51204 (local address 127.10.205.124:45965)
0809 06:55:23.591665 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.591670 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.591684 (+ 14us) server_negotiation.cc:407] Connection header received
0809 06:55:23.591730 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.591733 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.591779 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.591889 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.592833 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.593894 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.595556 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.596167 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.596346 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.600203 (+ 3857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.600209 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.600214 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.600250 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.604235 (+ 3985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.605114 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.605117 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.605119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.605233 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.605648 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.605653 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.605656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.605971 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.606131 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.606519 (+ 388us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.606747 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":54}
I20260809 06:55:23.607221 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.591269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51204)
0809 06:55:23.591434 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.591453 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:23.591554 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:23.591902 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:23.591906 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:23.592469 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:23.592679 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.592690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.594053 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.594058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.595413 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.595429 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.596354 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.596359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.596607 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.597184 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:23.597231 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:23.599992 (+ 2761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:23.604412 (+ 4420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.604418 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.604421 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.604998 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.605353 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.605357 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.605361 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.605498 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.606081 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:23.606086 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:23.606267 (+ 181us) client_negotiation.cc:769] Sending connection context
0809 06:55:23.606416 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 06:55:23.606882 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":200}
I20260809 06:55:23.615152 25525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb: Bootstrap starting.
I20260809 06:55:23.615531 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.595130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32774 (local address 127.10.205.125:36553)
0809 06:55:23.595293 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.595300 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.595422 (+ 122us) server_negotiation.cc:407] Connection header received
0809 06:55:23.595624 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.595629 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.595706 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.595794 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.597582 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.598767 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.600226 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.600966 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.601105 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.606909 (+ 5804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.606917 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.606921 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.606968 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.611495 (+ 4527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.612658 (+ 1163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.612665 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.612669 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.612889 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.613430 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.613439 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.613443 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.613864 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.614148 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.614869 (+ 721us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.615138 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 06:55:23.621011 25544 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260809 06:55:23.621074 25525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb: Neither blocks nor log segments found. Creating new log.
W20260809 06:55:23.621160 25544 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:55:23.622269 25525 log.cc:824] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:23.625778 25525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb: No bootstrap required, opened a new log
I20260809 06:55:23.626984 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:55:23.617719 25299 master_runner.cc:186] Error getting master registration for 127.10.205.125:36553: OK, instance_id { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" instance_seqno: 1786258522972361 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 06:55:23.628789 25299 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 06:55:23.641036 25525 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } }
I20260809 06:55:23.642472 25525 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:23.642680 25525 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbfe1ade436f4ee6981dba2a24f108cb, State: Initialized, Role: FOLLOWER
W20260809 06:55:23.644763 25321 tablet.cc:2369] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:55:23.645081 25525 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } }
I20260809 06:55:23.656976 25554 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } } }
I20260809 06:55:23.657676 25554 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:55:23.658829 25525 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:55:23.664949 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.634346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32790 (local address 127.10.205.125:36553)
0809 06:55:23.634541 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.634549 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.641474 (+ 6925us) server_negotiation.cc:407] Connection header received
0809 06:55:23.641805 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.641811 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.641902 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.642008 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.647018 (+ 5010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.648303 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.652350 (+ 4047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.653061 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.653173 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.657153 (+ 3980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.657160 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.657164 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.657218 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.661107 (+ 3889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.662067 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.662075 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.662081 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.662336 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.662834 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.662839 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.662844 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.663229 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.663540 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.664219 (+ 679us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.664552 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:55:23.672767 25531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.641519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51210 (local address 127.10.205.124:45965)
0809 06:55:23.641700 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.641706 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.643901 (+ 2195us) server_negotiation.cc:407] Connection header received
0809 06:55:23.644144 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.644150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.644229 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.644383 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.648119 (+ 3736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.649215 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.656466 (+ 7251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.657366 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.657489 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.661756 (+ 4267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.661767 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.661776 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.661839 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.667200 (+ 5361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.669050 (+ 1850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.669059 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.669066 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.669321 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.669951 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.669960 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.669966 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.670472 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.670829 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.671724 (+ 895us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.672080 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 06:55:23.676723 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.634220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60860 (local address 127.10.205.126:42767)
0809 06:55:23.634446 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.634453 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.641109 (+ 6656us) server_negotiation.cc:407] Connection header received
0809 06:55:23.641348 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.641356 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.641467 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.641583 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.645087 (+ 3504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.646524 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.649134 (+ 2610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.650142 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.650300 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.669079 (+ 18779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.669087 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.669092 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.669146 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.673030 (+ 3884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.674029 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.674036 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.674040 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.674217 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.674704 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.674709 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.674713 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.675127 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.675394 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.676020 (+ 626us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.676294 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
W20260809 06:55:23.699455 25566 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:55:23.699728 25566 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:55:23.690217 25456 master_runner.cc:186] Error getting master registration for 127.10.205.125:36553: OK, instance_id { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" instance_seqno: 1786258522972361 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 06:55:23.703085 25456 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 06:55:23.705648 25448 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } attempt: 5
Aug 09 06:55:23 dist-test-slave-0b58 krb5kdc[25285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258522, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.125@KRBTEST.COM for kudu/127.10.205.124@KRBTEST.COM
I20260809 06:55:23.722105 25531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.706441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51218 (local address 127.10.205.124:45965)
0809 06:55:23.706640 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:23.706644 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:23.706923 (+ 279us) server_negotiation.cc:407] Connection header received
0809 06:55:23.707125 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:23.707132 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:23.707219 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:23.707371 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:23.708216 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.709133 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.710773 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.711501 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.711624 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.716309 (+ 4685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:23.716316 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:23.716321 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:23.716362 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:23.719256 (+ 2894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.719903 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.719910 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.719913 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.720092 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:23.720524 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:23.720530 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:23.720534 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:23.720856 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:23.721056 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:23.721472 (+ 416us) server_negotiation.cc:299] Negotiation successful
0809 06:55:23.721701 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 06:55:23.722141 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:23.706382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:45965 (local address 127.0.0.1:51218)
0809 06:55:23.706823 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:23.706840 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:23.706984 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:23.707454 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:23.707459 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:23.707899 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:23.708061 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.708070 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.709305 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.709310 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.710625 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:23.710639 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:23.711856 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:23.711864 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:23.712074 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:23.712859 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:23.712883 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:23.716083 (+ 3200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:23.719399 (+ 3316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.719404 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.719409 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.719781 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.720226 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:23.720232 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:23.720236 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:23.720415 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:23.721017 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:23.721022 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:23.721220 (+ 198us) client_negotiation.cc:769] Sending connection context
0809 06:55:23.721369 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 06:55:23.721678 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311}
I20260809 06:55:23.729065 25448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b: Bootstrap starting.
I20260809 06:55:23.732560 25448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:23.733798 25448 log.cc:824] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:23.739830 25448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b: No bootstrap required, opened a new log
I20260809 06:55:23.747244 25448 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } }
I20260809 06:55:23.747602 25448 raft_consensus.cc:374] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:23.747752 25448 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ec2fd366f44121863a3a9472242b4b, State: Initialized, Role: FOLLOWER
I20260809 06:55:23.748449 25448 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } }
I20260809 06:55:23.752457 25569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } } }
I20260809 06:55:23.752957 25569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:55:23.753785 25448 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [sys.catalog]: configured and running, proceeding with master startup.
W20260809 06:55:23.766968 25477 tablet.cc:2369] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:55:23.772035 25376 master_runner.cc:263] No leader master found from master 97ec2fd366f44121863a3a9472242b4b
I20260809 06:55:23.772225 25376 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 06:55:23.775105 25580 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:55:23.775380 25580 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:55:23.956810 25533 raft_consensus.cc:482] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:55:23.957216 25533 raft_consensus.cc:504] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } }
I20260809 06:55:23.958917 25533 leader_election.cc:288] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ec2fd366f44121863a3a9472242b4b (127.10.205.125:36553), fbfe1ade436f4ee6981dba2a24f108cb (127.10.205.124:45965)
W20260809 06:55:23.960731 25398 tablet.cc:2369] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:55:23.960475 25499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "244e15013630402c8e0fa8c6bd653ebd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" is_pre_election: true
I20260809 06:55:23.961220 25499 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244e15013630402c8e0fa8c6bd653ebd in term 0.
I20260809 06:55:23.962709 25420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "244e15013630402c8e0fa8c6bd653ebd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ec2fd366f44121863a3a9472242b4b" is_pre_election: true
I20260809 06:55:23.963279 25420 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244e15013630402c8e0fa8c6bd653ebd in term 0.
I20260809 06:55:23.964146 25318 leader_election.cc:302] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244e15013630402c8e0fa8c6bd653ebd, fbfe1ade436f4ee6981dba2a24f108cb; no voters:
I20260809 06:55:23.965262 25533 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:55:23.965431 25533 raft_consensus.cc:482] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:55:23.965528 25533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:23.969262 25533 raft_consensus.cc:504] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } }
I20260809 06:55:23.970664 25420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "244e15013630402c8e0fa8c6bd653ebd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ec2fd366f44121863a3a9472242b4b"
I20260809 06:55:23.970911 25420 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:23.974754 25420 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244e15013630402c8e0fa8c6bd653ebd in term 1.
I20260809 06:55:23.975428 25317 leader_election.cc:302] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244e15013630402c8e0fa8c6bd653ebd, 97ec2fd366f44121863a3a9472242b4b; no voters:
I20260809 06:55:23.979921 25499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "244e15013630402c8e0fa8c6bd653ebd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbfe1ade436f4ee6981dba2a24f108cb"
I20260809 06:55:23.980195 25499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:23.983803 25499 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244e15013630402c8e0fa8c6bd653ebd in term 1.
I20260809 06:55:23.984795 25533 leader_election.cc:288] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [CANDIDATE]: Term 1 election: Requested vote from peers 97ec2fd366f44121863a3a9472242b4b (127.10.205.125:36553), fbfe1ade436f4ee6981dba2a24f108cb (127.10.205.124:45965)
I20260809 06:55:23.985286 25533 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:55:23.989735 25533 raft_consensus.cc:686] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [term 1 LEADER]: Becoming Leader. State: Replica: 244e15013630402c8e0fa8c6bd653ebd, State: Running, Role: LEADER
I20260809 06:55:23.990679 25533 consensus_queue.cc:237] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } }
I20260809 06:55:24.011498 25582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 244e15013630402c8e0fa8c6bd653ebd. Latest consensus state: current_term: 1 leader_uuid: "244e15013630402c8e0fa8c6bd653ebd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } } }
I20260809 06:55:24.012106 25582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:24.024999 25584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:55:24.027557 25584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:55:24.045220 25499 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [term 1 FOLLOWER]: Refusing update from remote peer 244e15013630402c8e0fa8c6bd653ebd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:55:24.046592 25582 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:55:24.054816 25420 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [term 1 FOLLOWER]: Refusing update from remote peer 244e15013630402c8e0fa8c6bd653ebd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:55:24.056097 25582 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:55:24.072817 25554 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 244e15013630402c8e0fa8c6bd653ebd. Latest consensus state: current_term: 1 leader_uuid: "244e15013630402c8e0fa8c6bd653ebd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } } }
I20260809 06:55:24.073231 25554 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:55:24.081703 25554 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "244e15013630402c8e0fa8c6bd653ebd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } } }
I20260809 06:55:24.082012 25554 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:55:24.095165 25582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "244e15013630402c8e0fa8c6bd653ebd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } } }
I20260809 06:55:24.095531 25582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:24.096609 25584 catalog_manager.cc:1347] Generated new cluster ID: e0b82704a9d24d71ad8c3d9f35a28d84
I20260809 06:55:24.096738 25584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:55:24.123250 25569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 244e15013630402c8e0fa8c6bd653ebd. Latest consensus state: current_term: 1 leader_uuid: "244e15013630402c8e0fa8c6bd653ebd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } } }
I20260809 06:55:24.123697 25569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:55:24.127048 25533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "244e15013630402c8e0fa8c6bd653ebd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } } }
I20260809 06:55:24.127465 25533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:24.129678 25588 mvcc.cc:205] Tried to move back new op lower bound from 7316514914476867584 to 7316514914282020864. Current Snapshot: MvccSnapshot[applied={T|T < 7316514914476867584}]
I20260809 06:55:24.142735 25569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "244e15013630402c8e0fa8c6bd653ebd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244e15013630402c8e0fa8c6bd653ebd" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42767 } } peers { permanent_uuid: "97ec2fd366f44121863a3a9472242b4b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 36553 } } peers { permanent_uuid: "fbfe1ade436f4ee6981dba2a24f108cb" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 45965 } } }
I20260809 06:55:24.143057 25569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:55:24.159540 25584 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:55:24.164194 25584 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:55:24.184039 25584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 244e15013630402c8e0fa8c6bd653ebd: Generated new TSK 0
I20260809 06:55:24.185379 25584 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:55:24.701840 25566 catalog_manager.cc:1259] Loaded cluster ID: e0b82704a9d24d71ad8c3d9f35a28d84
I20260809 06:55:24.701967 25566 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb: loading cluster ID for follower catalog manager: success
I20260809 06:55:24.704493 25566 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb: acquiring CA information for follower catalog manager: success
I20260809 06:55:24.706436 25566 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fbfe1ade436f4ee6981dba2a24f108cb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:55:24.777532 25580 catalog_manager.cc:1259] Loaded cluster ID: e0b82704a9d24d71ad8c3d9f35a28d84
I20260809 06:55:24.777662 25580 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b: loading cluster ID for follower catalog manager: success
I20260809 06:55:24.780438 25580 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b: acquiring CA information for follower catalog manager: success
I20260809 06:55:24.782269 25580 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 97ec2fd366f44121863a3a9472242b4b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:55:24.803700 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 25299
I20260809 06:55:24.805387 25363 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:24.918818 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 25299
I20260809 06:55:24.944814 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 25376
I20260809 06:55:24.945946 25442 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:25.054945 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 25376
I20260809 06:55:25.078809 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 25456
I20260809 06:55:25.080199 25519 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:25.188989 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 25456
2026-08-09T06:55:25Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4692 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:55:25 dist-test-slave-0b58 krb5kdc[25604](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:55:25 dist-test-slave-0b58 krb5kdc[25604](info): set up 2 sockets
Aug 09 06:55:25 dist-test-slave-0b58 krb5kdc[25604](info): commencing operation
krb5kdc: starting...
W20260809 06:55:26.339609 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.004s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:55:26 dist-test-slave-0b58 krb5kdc[25604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258526, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:55:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:55:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:55:26.636237 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:38995
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:36597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:38995
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:26.982724 25617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:26.983044 25617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:26.983181 25617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:26.990940 25617 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:55:26.991073 25617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:26.991139 25617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:26.991267 25617 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:55:26.991344 25617 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:55:27.001979 25617 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:36597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:38995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:38995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:27.003537 25617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:27.005010 25617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:27.017835 25622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:27.018028 25625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:27.017865 25623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:27.018714 25617 server_base.cc:1034] running on GCE node
I20260809 06:55:27.019629 25617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:27.021304 25617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:27.022548 25617 hybrid_clock.cc:648] HybridClock initialized: now 1786258527022492 us; error 38 us; skew 500 ppm
I20260809 06:55:27.022962 25617 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:27 dist-test-slave-0b58 krb5kdc[25604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258527, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:27.031759 25617 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:55:27.033495 25617 webserver.cc:460] Webserver started at http://127.10.205.126:45449/ using document root <none> and password file <none>
I20260809 06:55:27.034240 25617 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:27.034379 25617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:27.034731 25617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:55:27.038239 25617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "21f0e76d9261423d913d14fd0f88e88b"
format_stamp: "Formatted at 2026-08-09 06:55:27 on dist-test-slave-0b58"
server_key: "268c195a7587b3efe4059a10f5578652"
server_key_iv: "ac59eea8bce6005cd5fbca932a5cc75b"
server_key_version: "encryptionkey@0"
I20260809 06:55:27.039077 25617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "21f0e76d9261423d913d14fd0f88e88b"
format_stamp: "Formatted at 2026-08-09 06:55:27 on dist-test-slave-0b58"
server_key: "268c195a7587b3efe4059a10f5578652"
server_key_iv: "ac59eea8bce6005cd5fbca932a5cc75b"
server_key_version: "encryptionkey@0"
I20260809 06:55:27.044785 25617 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260809 06:55:27.048365 25634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:27.049690 25617 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:55:27.049881 25617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "21f0e76d9261423d913d14fd0f88e88b"
format_stamp: "Formatted at 2026-08-09 06:55:27 on dist-test-slave-0b58"
server_key: "268c195a7587b3efe4059a10f5578652"
server_key_iv: "ac59eea8bce6005cd5fbca932a5cc75b"
server_key_version: "encryptionkey@0"
I20260809 06:55:27.050101 25617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:27.073303 25617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:27.077505 25617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:27.077831 25617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:27.097286 25617 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:38995
I20260809 06:55:27.097299 25686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:38995 every 8 connection(s)
I20260809 06:55:27.098770 25617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:55:27.102653 25687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:27.106453 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 25617
I20260809 06:55:27.106701 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:55:27.107404 11061 external_mini_cluster.cc:1428] Setting key 0ca633705fad99c5ce2fb03adf7dac78
I20260809 06:55:27.116571 25687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b: Bootstrap starting.
I20260809 06:55:27.120786 25687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:27.121913 25687 log.cc:824] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:55:27 dist-test-slave-0b58 krb5kdc[25604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258526, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:27.125495 25687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b: No bootstrap required, opened a new log
I20260809 06:55:27.132537 25691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:27.109450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56128 (local address 127.10.205.126:38995)
0809 06:55:27.110295 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:27.110311 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:27.110363 (+ 52us) server_negotiation.cc:407] Connection header received
0809 06:55:27.112162 (+ 1799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:27.112193 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:27.112780 (+ 587us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:27.113266 (+ 486us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:27.114697 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:27.116855 (+ 2158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:27.118390 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:27.119539 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:27.119729 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:27.124557 (+ 4828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:27.124566 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:27.124581 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:27.124617 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:27.127891 (+ 3274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:27.128969 (+ 1078us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:27.128975 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:27.128981 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:27.129155 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:27.129612 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:27.129615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:27.129617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:27.130146 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:27.130366 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:27.130906 (+ 540us) server_negotiation.cc:299] Negotiation successful
0809 06:55:27.131337 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":365,"threads_started":1}
I20260809 06:55:27.135636 25687 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21f0e76d9261423d913d14fd0f88e88b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38995 } }
I20260809 06:55:27.136145 25687 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:27.136345 25687 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21f0e76d9261423d913d14fd0f88e88b, State: Initialized, Role: FOLLOWER
I20260809 06:55:27.136873 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:55:27.136988 25687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21f0e76d9261423d913d14fd0f88e88b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38995 } }
I20260809 06:55:27.137269 25687 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:55:27.137428 25687 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:55:27.137619 25687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:27.140142 25687 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21f0e76d9261423d913d14fd0f88e88b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38995 } }
I20260809 06:55:27.140744 25687 leader_election.cc:302] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21f0e76d9261423d913d14fd0f88e88b; no voters:
I20260809 06:55:27.141338 25687 leader_election.cc:288] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:55:27.141495 25693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:55:27.142316 25693 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [term 1 LEADER]: Becoming Leader. State: Replica: 21f0e76d9261423d913d14fd0f88e88b, State: Running, Role: LEADER
I20260809 06:55:27.142848 25693 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21f0e76d9261423d913d14fd0f88e88b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38995 } }
I20260809 06:55:27.143611 25687 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:55:27.146209 25696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21f0e76d9261423d913d14fd0f88e88b. Latest consensus state: current_term: 1 leader_uuid: "21f0e76d9261423d913d14fd0f88e88b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21f0e76d9261423d913d14fd0f88e88b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38995 } } }
I20260809 06:55:27.146694 25696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:27.146415 25695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21f0e76d9261423d913d14fd0f88e88b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21f0e76d9261423d913d14fd0f88e88b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 38995 } } }
I20260809 06:55:27.146869 25695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:27.149094 25699 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:55:27.154450 25699 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:55:27.163555 25699 catalog_manager.cc:1347] Generated new cluster ID: 2975d1da984f471c9febaf54d39e60f1
I20260809 06:55:27.163678 25699 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:55:27.192412 25699 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:55:27.194375 25699 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:55:27.208514 25699 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21f0e76d9261423d913d14fd0f88e88b: Generated new TSK 0
I20260809 06:55:27.209414 25699 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:55:27.250423 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 25617
I20260809 06:55:27.251729 25682 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:27.350248 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 25617
2026-08-09T06:55:27Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2158 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:55:27 dist-test-slave-0b58 krb5kdc[25717](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:55:27 dist-test-slave-0b58 krb5kdc[25717](info): set up 2 sockets
Aug 09 06:55:27 dist-test-slave-0b58 krb5kdc[25717](info): commencing operation
krb5kdc: starting...
W20260809 06:55:28.487375 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:55:28 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:55:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:55:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:55:28.787375 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:34639
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:34639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:29.133757 25731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:29.134116 25731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:29.134296 25731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:29.141666 25731 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:55:29.141829 25731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:29.141939 25731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:29.142043 25731 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:55:29.142127 25731 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:55:29.152810 25731 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:34639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:34639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:29.154244 25731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:29.155620 25731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:29.168424 25736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:29.168532 25739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:29.168494 25737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:29.169448 25731 server_base.cc:1034] running on GCE node
I20260809 06:55:29.170363 25731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:29.171917 25731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:29.173197 25731 hybrid_clock.cc:648] HybridClock initialized: now 1786258529173123 us; error 50 us; skew 500 ppm
I20260809 06:55:29.173602 25731 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:29 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258529, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:29.176992 25731 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:55:29.178640 25731 webserver.cc:460] Webserver started at http://127.10.205.126:44197/ using document root <none> and password file <none>
I20260809 06:55:29.179399 25731 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:29.179555 25731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:29.179893 25731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:55:29.183272 25731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "fe584539bd0a42c89d3bf7b64f40698e"
format_stamp: "Formatted at 2026-08-09 06:55:29 on dist-test-slave-0b58"
server_key: "1f15e0106398898980b501f372985837"
server_key_iv: "b0d9eeff068f7c9479672cc1782fe01a"
server_key_version: "encryptionkey@0"
I20260809 06:55:29.184109 25731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "fe584539bd0a42c89d3bf7b64f40698e"
format_stamp: "Formatted at 2026-08-09 06:55:29 on dist-test-slave-0b58"
server_key: "1f15e0106398898980b501f372985837"
server_key_iv: "b0d9eeff068f7c9479672cc1782fe01a"
server_key_version: "encryptionkey@0"
I20260809 06:55:29.189742 25731 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 06:55:29.193499 25746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:29.194926 25731 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:55:29.195144 25731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "fe584539bd0a42c89d3bf7b64f40698e"
format_stamp: "Formatted at 2026-08-09 06:55:29 on dist-test-slave-0b58"
server_key: "1f15e0106398898980b501f372985837"
server_key_iv: "b0d9eeff068f7c9479672cc1782fe01a"
server_key_version: "encryptionkey@0"
I20260809 06:55:29.195394 25731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:29.213007 25731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:29.217311 25731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:29.217664 25731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:29.238127 25731 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:34639
I20260809 06:55:29.238152 25799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:34639 every 8 connection(s)
I20260809 06:55:29.239732 25731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:55:29.243587 25800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:29.246819 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 25731
I20260809 06:55:29.247078 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:55:29.247973 11061 external_mini_cluster.cc:1428] Setting key 353fca3a49b2a3a3aa9f2bd958b2721d
I20260809 06:55:29.257236 25800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Bootstrap starting.
I20260809 06:55:29.261665 25800 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:29.263118 25800 log.cc:824] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:55:29 dist-test-slave-0b58 krb5kdc[25717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:29.267132 25800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: No bootstrap required, opened a new log
I20260809 06:55:29.273397 25803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:29.250307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50520 (local address 127.10.205.126:34639)
0809 06:55:29.251181 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:29.251195 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:29.251242 (+ 47us) server_negotiation.cc:407] Connection header received
0809 06:55:29.253133 (+ 1891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:29.253156 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:29.253572 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:29.253926 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:29.255725 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:29.257228 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:29.259131 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:29.260045 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:29.260175 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:29.265603 (+ 5428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:29.265611 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:29.265626 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:29.265661 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:29.268873 (+ 3212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:29.269692 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:29.269703 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:29.269710 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:29.269887 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:29.270333 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:29.270343 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:29.270345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:29.270927 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:29.271255 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:29.271796 (+ 541us) server_negotiation.cc:299] Negotiation successful
0809 06:55:29.272302 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":404,"threads_started":1}
I20260809 06:55:29.275920 25800 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } }
I20260809 06:55:29.276366 25800 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:29.276484 25800 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe584539bd0a42c89d3bf7b64f40698e, State: Initialized, Role: FOLLOWER
I20260809 06:55:29.277058 25800 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } }
I20260809 06:55:29.277278 25800 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:55:29.277384 25800 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:55:29.277505 25800 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:29.279692 25800 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } }
I20260809 06:55:29.280120 25800 leader_election.cc:302] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe584539bd0a42c89d3bf7b64f40698e; no voters:
I20260809 06:55:29.280764 25800 leader_election.cc:288] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:55:29.280937 25806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:55:29.281587 25806 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 1 LEADER]: Becoming Leader. State: Replica: fe584539bd0a42c89d3bf7b64f40698e, State: Running, Role: LEADER
I20260809 06:55:29.282302 25806 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } }
I20260809 06:55:29.284021 25800 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:55:29.285389 25808 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe584539bd0a42c89d3bf7b64f40698e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } } }
I20260809 06:55:29.285357 25807 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe584539bd0a42c89d3bf7b64f40698e. Latest consensus state: current_term: 1 leader_uuid: "fe584539bd0a42c89d3bf7b64f40698e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } } }
I20260809 06:55:29.285972 25808 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:29.286536 25807 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:29.294791 25811 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:55:29.300225 25811 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:55:29.311498 25811 catalog_manager.cc:1347] Generated new cluster ID: 6243e2ce4c1646049b18b552fabedfbc
I20260809 06:55:29.311635 25811 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:55:29.332011 25811 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:55:29.333421 25811 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:55:29.343132 25811 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Generated new TSK 0
I20260809 06:55:29.344278 25811 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:55:29.420073 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34639
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:29.770588 25829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:29.770911 25829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:29.771070 25829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:29.778939 25829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:29.779094 25829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:29.779290 25829 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:55:29.789803 25829 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:29.791177 25829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:29.792655 25829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:29.806130 25836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:29.806188 25835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:29.806224 25838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:29.807025 25829 server_base.cc:1034] running on GCE node
I20260809 06:55:29.807731 25829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:29.808781 25829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:29.810009 25829 hybrid_clock.cc:648] HybridClock initialized: now 1786258529809945 us; error 58 us; skew 500 ppm
I20260809 06:55:29.810340 25829 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:29 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258529, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:29.813622 25829 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:55:29.815044 25829 webserver.cc:460] Webserver started at http://127.10.205.65:33867/ using document root <none> and password file <none>
I20260809 06:55:29.815764 25829 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:29.815907 25829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:29.816212 25829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:55:29.819152 25829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6"
format_stamp: "Formatted at 2026-08-09 06:55:29 on dist-test-slave-0b58"
server_key: "2d8a9c7089f8db74e65d0ee92da25419"
server_key_iv: "ee6b03b6df4d10257cd90b4f02ce1314"
server_key_version: "encryptionkey@0"
I20260809 06:55:29.819964 25829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6"
format_stamp: "Formatted at 2026-08-09 06:55:29 on dist-test-slave-0b58"
server_key: "2d8a9c7089f8db74e65d0ee92da25419"
server_key_iv: "ee6b03b6df4d10257cd90b4f02ce1314"
server_key_version: "encryptionkey@0"
I20260809 06:55:29.825381 25829 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 06:55:29.828977 25845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:29.830327 25829 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:55:29.830502 25829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6"
format_stamp: "Formatted at 2026-08-09 06:55:29 on dist-test-slave-0b58"
server_key: "2d8a9c7089f8db74e65d0ee92da25419"
server_key_iv: "ee6b03b6df4d10257cd90b4f02ce1314"
server_key_version: "encryptionkey@0"
I20260809 06:55:29.830708 25829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:29.850788 25829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:29.855158 25829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:29.855469 25829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:29.856541 25829 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:29.857966 25829 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:29.858068 25829 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:29.858223 25829 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:29.858294 25829 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:29.892154 25829 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:42363
I20260809 06:55:29.892249 25964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:42363 every 8 connection(s)
I20260809 06:55:29.893659 25829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:55:29.903746 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 25829
I20260809 06:55:29.903983 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:55:29.904768 11061 external_mini_cluster.cc:1428] Setting key 07a0b65aa3d2f15ecc7724c307887e33
Aug 09 06:55:29 dist-test-slave-0b58 krb5kdc[25717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258529, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:29.915468 25967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:29.896590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:47327 (local address 127.10.205.126:34639)
0809 06:55:29.897136 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:29.897141 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:29.897973 (+ 832us) server_negotiation.cc:407] Connection header received
0809 06:55:29.900114 (+ 2141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:29.900120 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:29.900230 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:29.900402 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:29.902042 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:29.902893 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:29.904847 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:29.905355 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:29.905508 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:29.909585 (+ 4077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:29.909591 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:29.909594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:29.909629 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:29.912427 (+ 2798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:29.913160 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:29.913166 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:29.913173 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:29.913292 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:29.913708 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:29.913713 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:29.913716 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:29.913987 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:29.914140 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:29.914852 (+ 712us) server_negotiation.cc:299] Negotiation successful
0809 06:55:29.915093 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":275,"threads_started":1}
I20260809 06:55:29.916530 25968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:29.896986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:47327)
0809 06:55:29.897792 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:29.897840 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:29.899824 (+ 1984us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:29.900662 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:29.900671 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:29.901236 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:29.901853 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:29.901871 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:29.903072 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:29.903077 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:29.904643 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:29.904676 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:29.905612 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:29.905622 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:29.905953 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:29.906824 (+ 871us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:29.906870 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:29.909345 (+ 2475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:29.912566 (+ 3221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:29.912576 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:29.912596 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:29.913031 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:29.913403 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:29.913407 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:29.913411 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:29.913590 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:29.914115 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:29.914122 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:29.914475 (+ 353us) client_negotiation.cc:769] Sending connection context
0809 06:55:29.914733 (+ 258us) client_negotiation.cc:240] Negotiation successful
0809 06:55:29.915273 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":295,"threads_started":1}
I20260809 06:55:29.918203 25965 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34639
I20260809 06:55:29.918601 25965 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:29.919566 25965 heartbeater.cc:511] Master 127.10.205.126:34639 requested a full tablet report, sending...
I20260809 06:55:29.922106 25763 ts_manager.cc:194] Registered new tserver with Master: 630aa5d2bbbb40b38cbbab5c0575a4c6 (127.10.205.65:42363)
I20260809 06:55:29.923686 25763 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:47327
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:55:29.971462 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34639
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:30.313946 25972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:30.314306 25972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:30.314476 25972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:30.321967 25972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:30.322147 25972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:30.322376 25972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:55:30.332434 25972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:30.333819 25972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:30.335314 25972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:30.348846 25978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:30.348814 25980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:30.348874 25977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:30.349663 25972 server_base.cc:1034] running on GCE node
I20260809 06:55:30.350261 25972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:30.351193 25972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:30.352425 25972 hybrid_clock.cc:648] HybridClock initialized: now 1786258530352366 us; error 47 us; skew 500 ppm
I20260809 06:55:30.352782 25972 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:30 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258530, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:30.355842 25972 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:55:30.357215 25972 webserver.cc:460] Webserver started at http://127.10.205.66:36109/ using document root <none> and password file <none>
I20260809 06:55:30.357884 25972 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:30.357991 25972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:30.358248 25972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:55:30.361147 25972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "a026fd6bbc2f4280b07dcbefc73e289f"
format_stamp: "Formatted at 2026-08-09 06:55:30 on dist-test-slave-0b58"
server_key: "b0fdf916f08de28522259a71242e4a53"
server_key_iv: "559d3bd88ba6e1e97bd13715ed7d45dc"
server_key_version: "encryptionkey@0"
I20260809 06:55:30.361943 25972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "a026fd6bbc2f4280b07dcbefc73e289f"
format_stamp: "Formatted at 2026-08-09 06:55:30 on dist-test-slave-0b58"
server_key: "b0fdf916f08de28522259a71242e4a53"
server_key_iv: "559d3bd88ba6e1e97bd13715ed7d45dc"
server_key_version: "encryptionkey@0"
I20260809 06:55:30.367254 25972 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:55:30.370864 25987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:30.372179 25972 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 06:55:30.372403 25972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "a026fd6bbc2f4280b07dcbefc73e289f"
format_stamp: "Formatted at 2026-08-09 06:55:30 on dist-test-slave-0b58"
server_key: "b0fdf916f08de28522259a71242e4a53"
server_key_iv: "559d3bd88ba6e1e97bd13715ed7d45dc"
server_key_version: "encryptionkey@0"
I20260809 06:55:30.372596 25972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:30.405248 25972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:30.409420 25972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:30.409734 25972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:30.410692 25972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:30.412060 25972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:30.412137 25972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:30.412230 25972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:30.412322 25972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:30.448093 25972 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:36405
I20260809 06:55:30.448137 26102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:36405 every 8 connection(s)
I20260809 06:55:30.449494 25972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:55:30.451542 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 25972
I20260809 06:55:30.451741 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:55:30.452311 11061 external_mini_cluster.cc:1428] Setting key 9ad7d33cdaa7c8af080fb05b0e046079
Aug 09 06:55:30 dist-test-slave-0b58 krb5kdc[25717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258530, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:30.472923 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:30.452233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:45031 (local address 127.10.205.126:34639)
0809 06:55:30.456621 (+ 4388us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:30.456626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:30.456645 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:55:30.457155 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:30.457161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:30.457254 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:30.457368 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:30.458841 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:30.459554 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:30.461143 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:30.461584 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:30.461717 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:30.465450 (+ 3733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:30.465459 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:30.465467 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:30.465515 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:30.469199 (+ 3684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:30.470264 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:30.470268 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:30.470271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:30.470409 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:30.470932 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:30.470935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:30.470937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:30.471218 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:30.471333 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:30.472361 (+ 1028us) server_negotiation.cc:299] Negotiation successful
0809 06:55:30.472606 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4284,"thread_start_us":4162,"threads_started":1}
I20260809 06:55:30.474514 26107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:30.452841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:45031)
0809 06:55:30.453848 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:30.453921 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:30.456896 (+ 2975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:30.457602 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:30.457610 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:30.458112 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:30.458675 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:30.458692 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:30.459711 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:30.459715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:30.461002 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:30.461014 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:30.461824 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:30.461831 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:30.462060 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:30.462796 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:30.462823 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:30.465209 (+ 2386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:30.469368 (+ 4159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:30.469381 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:30.469401 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:30.470100 (+ 699us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:30.470528 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:30.470535 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:30.470541 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:30.470816 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:30.471343 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:30.471353 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:30.471881 (+ 528us) client_negotiation.cc:769] Sending connection context
0809 06:55:30.472207 (+ 326us) client_negotiation.cc:240] Negotiation successful
0809 06:55:30.472851 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":416,"threads_started":1}
I20260809 06:55:30.476193 26103 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34639
I20260809 06:55:30.476573 26103 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:30.477497 26103 heartbeater.cc:511] Master 127.10.205.126:34639 requested a full tablet report, sending...
I20260809 06:55:30.479097 25763 ts_manager.cc:194] Registered new tserver with Master: a026fd6bbc2f4280b07dcbefc73e289f (127.10.205.66:36405)
I20260809 06:55:30.480420 25763 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:45031
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:55:30.523458 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34639
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:30.867887 26110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:30.868185 26110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:30.868376 26110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:30.875982 26110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:30.876094 26110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:30.876365 26110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:55:30.886608 26110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:30.888024 26110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:30.889410 26110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:30.904225 26116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:30.904275 26118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:30.904350 26115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:30.904951 26110 server_base.cc:1034] running on GCE node
I20260809 06:55:30.905576 26110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:30.906574 26110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:30.907819 26110 hybrid_clock.cc:648] HybridClock initialized: now 1786258530907764 us; error 35 us; skew 500 ppm
I20260809 06:55:30.908200 26110 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:30 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258530, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:30.911334 26110 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:55:30.912954 26110 webserver.cc:460] Webserver started at http://127.10.205.67:33895/ using document root <none> and password file <none>
I20260809 06:55:30.913671 26110 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:30.913810 26110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:30.914120 26110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:55:30.917012 26110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "43aabe41c07a43948348e1b6672d7515"
format_stamp: "Formatted at 2026-08-09 06:55:30 on dist-test-slave-0b58"
server_key: "59ad0196816c745beca26f0469836ddd"
server_key_iv: "1cda199b5b4dab380b1ded972afd6a0d"
server_key_version: "encryptionkey@0"
I20260809 06:55:30.917796 26110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "43aabe41c07a43948348e1b6672d7515"
format_stamp: "Formatted at 2026-08-09 06:55:30 on dist-test-slave-0b58"
server_key: "59ad0196816c745beca26f0469836ddd"
server_key_iv: "1cda199b5b4dab380b1ded972afd6a0d"
server_key_version: "encryptionkey@0"
I20260809 06:55:30.922813 26110 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:55:30.926345 26126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:30.927423 25965 heartbeater.cc:503] Master 127.10.205.126:34639 was elected leader, sending a full tablet report...
I20260809 06:55:30.927796 26110 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:55:30.927964 26110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "43aabe41c07a43948348e1b6672d7515"
format_stamp: "Formatted at 2026-08-09 06:55:30 on dist-test-slave-0b58"
server_key: "59ad0196816c745beca26f0469836ddd"
server_key_iv: "1cda199b5b4dab380b1ded972afd6a0d"
server_key_version: "encryptionkey@0"
I20260809 06:55:30.928186 26110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:30.954469 26110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:30.959043 26110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:30.959378 26110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:30.960412 26110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:30.961779 26110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:30.961884 26110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:30.962023 26110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:30.962091 26110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:30.995553 26110 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:34085
I20260809 06:55:30.995617 26243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:34085 every 8 connection(s)
I20260809 06:55:30.997004 26110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:55:31.003670 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 26110
I20260809 06:55:31.003873 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:55:31.004374 11061 external_mini_cluster.cc:1428] Setting key 73872bbcab465e71c688452e43a947f7
Aug 09 06:55:31 dist-test-slave-0b58 krb5kdc[25717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258530, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:31.017328 26246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:30.999650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:42835 (local address 127.10.205.126:34639)
0809 06:55:31.000109 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:31.000113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:31.001193 (+ 1080us) server_negotiation.cc:407] Connection header received
0809 06:55:31.003098 (+ 1905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:31.003104 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:31.003261 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:31.003396 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:31.005174 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.006013 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.007611 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.008027 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.008167 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.011607 (+ 3440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:31.011612 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:31.011616 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:31.011649 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:31.014171 (+ 2522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:31.014946 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:31.014950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:31.014952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:31.015075 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:31.015508 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:31.015512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:31.015521 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:31.015784 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:31.015944 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:31.016688 (+ 744us) server_negotiation.cc:299] Negotiation successful
0809 06:55:31.016912 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":227,"threads_started":1}
I20260809 06:55:31.018477 26247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.000242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:42835)
0809 06:55:31.001034 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:31.001073 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:31.002812 (+ 1739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:31.003621 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:31.003630 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:31.004326 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:31.004973 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:31.004991 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.006196 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.006202 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:31.007463 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:31.007476 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.008296 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.008307 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:31.008562 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.009188 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:31.009210 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:31.011402 (+ 2192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:31.014342 (+ 2940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:31.014351 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:31.014368 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:31.014814 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:31.015183 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:31.015188 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:31.015192 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:31.015378 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:31.015919 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:31.015927 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:31.016326 (+ 399us) client_negotiation.cc:769] Sending connection context
0809 06:55:31.016597 (+ 271us) client_negotiation.cc:240] Negotiation successful
0809 06:55:31.017161 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":269,"threads_started":1}
I20260809 06:55:31.020022 26244 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34639
I20260809 06:55:31.020354 26244 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:31.021127 26244 heartbeater.cc:511] Master 127.10.205.126:34639 requested a full tablet report, sending...
I20260809 06:55:31.022591 25762 ts_manager.cc:194] Registered new tserver with Master: 43aabe41c07a43948348e1b6672d7515 (127.10.205.67:34085)
I20260809 06:55:31.023470 25762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:42835
I20260809 06:55:31.032603 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:55:31.050047 26246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.037468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48240 (local address 127.10.205.126:34639)
0809 06:55:31.037715 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:31.037723 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:31.038132 (+ 409us) server_negotiation.cc:407] Connection header received
0809 06:55:31.038273 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:31.038277 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:31.038343 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:31.038423 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:31.039873 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.040723 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.042006 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.042411 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.042499 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.045095 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:31.045099 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:31.045102 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:31.045132 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:31.047604 (+ 2472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:31.048308 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:31.048313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:31.048315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:31.048442 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:31.048773 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:31.048776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:31.048778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:31.049084 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:31.049276 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:31.049539 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 06:55:31.049712 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:55:31.054324 25762 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48240:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:55:31.061291 25762 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:55:31.113999 26259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.073835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:42363 (local address 127.0.0.1:48818)
0809 06:55:31.085462 (+ 11627us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:31.085538 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:31.086887 (+ 1349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:31.106204 (+ 19317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:31.106209 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:31.106237 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:31.106696 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:31.106709 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.108619 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.108627 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:31.110966 (+ 2339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:31.110979 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.112955 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.112962 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:31.113160 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.113244 (+ 84us) client_negotiation.cc:769] Sending connection context
0809 06:55:31.113372 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 06:55:31.113557 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11262,"mutex_wait_us":33,"thread_start_us":31516,"threads_started":1}
I20260809 06:55:31.114849 26258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.077087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:34085 (local address 127.0.0.1:36864)
0809 06:55:31.105714 (+ 28627us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:31.105734 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:31.105963 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:31.106948 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:31.106951 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:31.106978 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:31.107355 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:31.107369 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.109395 (+ 2026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.109402 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:31.112174 (+ 2772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:31.112186 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.114067 (+ 1881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.114073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:31.114233 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.114274 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 06:55:31.114367 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 06:55:31.114488 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28437,"thread_start_us":26516,"threads_started":1}
I20260809 06:55:31.114885 26261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.074261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48818 (local address 127.10.205.65:42363)
0809 06:55:31.105406 (+ 31145us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:31.105414 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:31.105448 (+ 34us) server_negotiation.cc:407] Connection header received
0809 06:55:31.105559 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:31.105566 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:31.105917 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:31.106890 (+ 973us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:31.107218 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.108463 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.111122 (+ 2659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.112726 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.114084 (+ 1358us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.114313 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:31.114395 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 06:55:31.114553 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30930,"thread_start_us":30705,"threads_started":1}
I20260809 06:55:31.115383 26264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.077915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36864 (local address 127.10.205.67:34085)
0809 06:55:31.103551 (+ 25636us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:31.103566 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:31.105839 (+ 2273us) server_negotiation.cc:407] Connection header received
0809 06:55:31.106197 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:31.106207 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:31.106433 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:31.106608 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:31.107555 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.109216 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.112369 (+ 3153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.113594 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.113723 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.113962 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:31.114816 (+ 854us) server_negotiation.cc:299] Negotiation successful
0809 06:55:31.115014 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25352,"thread_start_us":25998,"threads_started":1}
I20260809 06:55:31.115830 26263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.074163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:36405 (local address 127.0.0.1:45232)
0809 06:55:31.102496 (+ 28333us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:31.102529 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:31.102744 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:31.105714 (+ 2970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:31.105724 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:31.105768 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:31.106353 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:31.106374 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.108415 (+ 2041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.108423 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:31.112707 (+ 4284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:31.112722 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.115054 (+ 2332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.115060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:31.115234 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.115262 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 06:55:31.115330 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 06:55:31.115483 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28096,"mutex_wait_us":89,"thread_start_us":10740,"threads_started":1}
I20260809 06:55:31.116439 26262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.074301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45232 (local address 127.10.205.66:36405)
0809 06:55:31.104775 (+ 30474us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:31.104785 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:31.104827 (+ 42us) server_negotiation.cc:407] Connection header received
0809 06:55:31.105054 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:31.105065 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:31.105397 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:31.106610 (+ 1213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:31.106861 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.108247 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.112931 (+ 4684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.114831 (+ 1900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.115652 (+ 821us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.115861 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:31.115938 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 06:55:31.116093 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30267,"thread_start_us":30138,"threads_started":1}
I20260809 06:55:31.119830 25896 tablet_service.cc:1467] Processing CreateTablet for tablet 2207e52aa5bf453996632772fa3e3546 (DEFAULT_TABLE table=test-table [id=97f69144643543f9b58d66603f7e3fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:55:31.121735 25896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2207e52aa5bf453996632772fa3e3546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:31.122159 26037 tablet_service.cc:1467] Processing CreateTablet for tablet 2207e52aa5bf453996632772fa3e3546 (DEFAULT_TABLE table=test-table [id=97f69144643543f9b58d66603f7e3fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:55:31.122159 26177 tablet_service.cc:1467] Processing CreateTablet for tablet 2207e52aa5bf453996632772fa3e3546 (DEFAULT_TABLE table=test-table [id=97f69144643543f9b58d66603f7e3fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:55:31.123600 26177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2207e52aa5bf453996632772fa3e3546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:31.123600 26037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2207e52aa5bf453996632772fa3e3546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:31.137400 26265 tablet_bootstrap.cc:492] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Bootstrap starting.
I20260809 06:55:31.139655 26267 tablet_bootstrap.cc:492] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f: Bootstrap starting.
I20260809 06:55:31.141230 26268 tablet_bootstrap.cc:492] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515: Bootstrap starting.
I20260809 06:55:31.142269 26265 tablet_bootstrap.cc:654] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:31.143261 26267 tablet_bootstrap.cc:654] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:31.143738 26265 log.cc:824] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:31.144410 26267 log.cc:824] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:31.144858 26268 tablet_bootstrap.cc:654] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:31.146160 26268 log.cc:824] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:31.147397 26265 tablet_bootstrap.cc:492] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6: No bootstrap required, opened a new log
I20260809 06:55:31.147519 26267 tablet_bootstrap.cc:492] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f: No bootstrap required, opened a new log
I20260809 06:55:31.147719 26265 ts_tablet_manager.cc:1397] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260809 06:55:31.147792 26267 ts_tablet_manager.cc:1397] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 06:55:31.148774 26268 tablet_bootstrap.cc:492] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515: No bootstrap required, opened a new log
I20260809 06:55:31.149045 26268 ts_tablet_manager.cc:1397] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 06:55:31.156852 26268 raft_consensus.cc:348] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } } peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } }
I20260809 06:55:31.157279 26268 raft_consensus.cc:374] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:31.157406 26268 raft_consensus.cc:729] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43aabe41c07a43948348e1b6672d7515, State: Initialized, Role: FOLLOWER
I20260809 06:55:31.158062 26268 consensus_queue.cc:260] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } } peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } }
I20260809 06:55:31.158977 26265 raft_consensus.cc:348] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } } peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } }
I20260809 06:55:31.159330 26244 heartbeater.cc:503] Master 127.10.205.126:34639 was elected leader, sending a full tablet report...
I20260809 06:55:31.159422 26265 raft_consensus.cc:374] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:31.159521 26265 raft_consensus.cc:729] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630aa5d2bbbb40b38cbbab5c0575a4c6, State: Initialized, Role: FOLLOWER
I20260809 06:55:31.160027 26268 ts_tablet_manager.cc:1428] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260809 06:55:31.160121 26265 consensus_queue.cc:260] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } } peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } }
I20260809 06:55:31.158977 26267 raft_consensus.cc:348] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } } peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } }
I20260809 06:55:31.160785 26267 raft_consensus.cc:374] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:31.160938 26267 raft_consensus.cc:729] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a026fd6bbc2f4280b07dcbefc73e289f, State: Initialized, Role: FOLLOWER
I20260809 06:55:31.161669 26267 consensus_queue.cc:260] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } } peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } }
I20260809 06:55:31.161975 26265 ts_tablet_manager.cc:1428] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Time spent starting tablet: real 0.014s user 0.008s sys 0.007s
I20260809 06:55:31.164361 26103 heartbeater.cc:503] Master 127.10.205.126:34639 was elected leader, sending a full tablet report...
I20260809 06:55:31.165074 26267 ts_tablet_manager.cc:1428] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f: Time spent starting tablet: real 0.017s user 0.015s sys 0.000s
I20260809 06:55:31.188532 26273 raft_consensus.cc:482] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:55:31.188831 26273 raft_consensus.cc:504] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } } peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } }
I20260809 06:55:31.190601 26273 leader_election.cc:288] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a026fd6bbc2f4280b07dcbefc73e289f (127.10.205.66:36405), 43aabe41c07a43948348e1b6672d7515 (127.10.205.67:34085)
I20260809 06:55:31.200664 26262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.191303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:41183 (local address 127.10.205.66:36405)
0809 06:55:31.191600 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:31.191610 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:31.192347 (+ 737us) server_negotiation.cc:407] Connection header received
0809 06:55:31.192675 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:31.192682 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:31.192771 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:31.192844 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:31.193757 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.194918 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.198207 (+ 3289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.199469 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.199661 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.199739 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:31.200227 (+ 488us) server_negotiation.cc:299] Negotiation successful
0809 06:55:31.200395 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260809 06:55:31.200661 26264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.191564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:51077 (local address 127.10.205.67:34085)
0809 06:55:31.191841 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:31.191850 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:31.192636 (+ 786us) server_negotiation.cc:407] Connection header received
0809 06:55:31.192796 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:31.192800 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:31.192873 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:31.192945 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:31.193749 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.194942 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.198207 (+ 3265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.199494 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.199661 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.199739 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:31.200227 (+ 488us) server_negotiation.cc:299] Negotiation successful
0809 06:55:31.200395 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 06:55:31.200950 26275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.191064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:34085 (local address 127.10.205.65:51077)
0809 06:55:31.192528 (+ 1464us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:31.192546 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:31.192670 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:31.192995 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:31.193003 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:31.193041 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:31.193582 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:31.193595 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.195112 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.195117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:31.198025 (+ 2908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:31.198042 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.199778 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.199783 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:31.200031 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.200086 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 06:55:31.200183 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 06:55:31.200380 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1341,"mutex_wait_us":308,"thread_start_us":760,"threads_started":1}
I20260809 06:55:31.201084 26276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.190863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:36405 (local address 127.10.205.65:41183)
0809 06:55:31.192194 (+ 1331us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:31.192218 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:31.192480 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:31.193064 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:31.193070 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:31.193098 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:31.193587 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:31.193595 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.195113 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.195117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:31.198025 (+ 2908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:31.198042 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.199759 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.199767 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:31.200007 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.200072 (+ 65us) client_negotiation.cc:769] Sending connection context
0809 06:55:31.200170 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 06:55:31.200380 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1166,"mutex_wait_us":297,"thread_start_us":1335,"threads_started":1}
W20260809 06:55:31.201637 26104 tablet.cc:2369] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:55:31.202150 26198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2207e52aa5bf453996632772fa3e3546" candidate_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43aabe41c07a43948348e1b6672d7515" is_pre_election: true
I20260809 06:55:31.202677 26198 raft_consensus.cc:2454] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630aa5d2bbbb40b38cbbab5c0575a4c6 in term 0.
I20260809 06:55:31.202940 26057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2207e52aa5bf453996632772fa3e3546" candidate_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" is_pre_election: true
I20260809 06:55:31.203444 26057 raft_consensus.cc:2454] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630aa5d2bbbb40b38cbbab5c0575a4c6 in term 0.
I20260809 06:55:31.203537 25847 leader_election.cc:302] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43aabe41c07a43948348e1b6672d7515, 630aa5d2bbbb40b38cbbab5c0575a4c6; no voters:
I20260809 06:55:31.203986 26273 raft_consensus.cc:2781] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:55:31.204147 26273 raft_consensus.cc:482] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:55:31.204295 26273 raft_consensus.cc:3037] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:31.206418 26273 raft_consensus.cc:504] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } } peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } }
I20260809 06:55:31.207058 26273 leader_election.cc:288] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [CANDIDATE]: Term 1 election: Requested vote from peers a026fd6bbc2f4280b07dcbefc73e289f (127.10.205.66:36405), 43aabe41c07a43948348e1b6672d7515 (127.10.205.67:34085)
I20260809 06:55:31.207494 26057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2207e52aa5bf453996632772fa3e3546" candidate_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a026fd6bbc2f4280b07dcbefc73e289f"
I20260809 06:55:31.207603 26198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2207e52aa5bf453996632772fa3e3546" candidate_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43aabe41c07a43948348e1b6672d7515"
I20260809 06:55:31.207728 26057 raft_consensus.cc:3037] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:31.207813 26198 raft_consensus.cc:3037] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:31.210995 26198 raft_consensus.cc:2454] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630aa5d2bbbb40b38cbbab5c0575a4c6 in term 1.
I20260809 06:55:31.210990 26057 raft_consensus.cc:2454] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630aa5d2bbbb40b38cbbab5c0575a4c6 in term 1.
I20260809 06:55:31.211388 25847 leader_election.cc:302] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43aabe41c07a43948348e1b6672d7515, 630aa5d2bbbb40b38cbbab5c0575a4c6; no voters:
I20260809 06:55:31.211716 26273 raft_consensus.cc:2781] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:55:31.212275 26273 raft_consensus.cc:686] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 1 LEADER]: Becoming Leader. State: Replica: 630aa5d2bbbb40b38cbbab5c0575a4c6, State: Running, Role: LEADER
I20260809 06:55:31.212847 26273 consensus_queue.cc:237] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } } peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } }
I20260809 06:55:31.217676 25762 catalog_manager.cc:5495] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 630aa5d2bbbb40b38cbbab5c0575a4c6 (127.10.205.65). New cstate: current_term: 1 leader_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } health_report { overall_health: UNKNOWN } } }
W20260809 06:55:31.248615 26245 tablet.cc:2369] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:55:31.249462 26261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.243804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48824 (local address 127.10.205.65:42363)
0809 06:55:31.244017 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:31.244025 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:31.244047 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:55:31.244178 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:31.244181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:31.244299 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:31.244458 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:55:31.244863 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.245599 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.247039 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.247464 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.247589 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.248112 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:55:31.248832 (+ 720us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:55:31.248983 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:31.249102 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 06:55:31.249190 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:55:31.257889 26057 raft_consensus.cc:1261] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f [term 1 FOLLOWER]: Refusing update from remote peer 630aa5d2bbbb40b38cbbab5c0575a4c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:55:31.257889 26198 raft_consensus.cc:1261] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515 [term 1 FOLLOWER]: Refusing update from remote peer 630aa5d2bbbb40b38cbbab5c0575a4c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:55:31.258930 26273 consensus_queue.cc:1035] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:55:31.259238 26277 consensus_queue.cc:1035] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:55:31.289896 25763 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:55:31.290156 25763 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:55:31.293977 25763 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Sending DeleteTablet for 3 replicas of tablet 2207e52aa5bf453996632772fa3e3546
I20260809 06:55:31.295303 26037 tablet_service.cc:1514] Processing DeleteTablet for tablet 2207e52aa5bf453996632772fa3e3546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:55:31 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:45232
I20260809 06:55:31.295315 25896 tablet_service.cc:1514] Processing DeleteTablet for tablet 2207e52aa5bf453996632772fa3e3546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:55:31 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:48818
I20260809 06:55:31.295413 26177 tablet_service.cc:1514] Processing DeleteTablet for tablet 2207e52aa5bf453996632772fa3e3546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:55:31 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:36864
I20260809 06:55:31.298400 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 25829
I20260809 06:55:31.307687 26290 tablet_replica.cc:330] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f: stopping tablet replica
I20260809 06:55:31.309134 26290 raft_consensus.cc:2229] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:55:31.310714 26290 raft_consensus.cc:2258] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:55:31.314113 26290 ts_tablet_manager.cc:1905] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:55:31.314488 26293 tablet_replica.cc:330] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515: stopping tablet replica
I20260809 06:55:31.314946 26293 raft_consensus.cc:2229] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:55:31.315120 26292 tablet_replica.cc:330] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6: stopping tablet replica
I20260809 06:55:31.315467 26293 raft_consensus.cc:2258] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:55:31.315541 26292 raft_consensus.cc:2229] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:55:31.316190 26292 raft_consensus.cc:2258] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:55:31.318439 26293 ts_tablet_manager.cc:1905] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:55:31.321161 26292 ts_tablet_manager.cc:1905] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:55:31.321717 26290 ts_tablet_manager.cc:1918] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:55:31.321945 26290 log.cc:1196] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/2207e52aa5bf453996632772fa3e3546
I20260809 06:55:31.322599 26290 ts_tablet_manager.cc:1939] T 2207e52aa5bf453996632772fa3e3546 P a026fd6bbc2f4280b07dcbefc73e289f: Deleting consensus metadata
I20260809 06:55:31.324608 25749 catalog_manager.cc:4841] TS a026fd6bbc2f4280b07dcbefc73e289f (127.10.205.66:36405): tablet 2207e52aa5bf453996632772fa3e3546 (table test-table [id=97f69144643543f9b58d66603f7e3fea]) successfully deleted
I20260809 06:55:31.325543 26293 ts_tablet_manager.cc:1918] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:55:31.325745 26293 log.cc:1196] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/2207e52aa5bf453996632772fa3e3546
I20260809 06:55:31.326416 26293 ts_tablet_manager.cc:1939] T 2207e52aa5bf453996632772fa3e3546 P 43aabe41c07a43948348e1b6672d7515: Deleting consensus metadata
I20260809 06:55:31.328383 25747 catalog_manager.cc:4841] TS 43aabe41c07a43948348e1b6672d7515 (127.10.205.67:34085): tablet 2207e52aa5bf453996632772fa3e3546 (table test-table [id=97f69144643543f9b58d66603f7e3fea]) successfully deleted
Aug 09 06:55:31 dist-test-slave-0b58 krb5kdc[25717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:55:31.331355 26292 ts_tablet_manager.cc:1918] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:55:31.331622 26292 log.cc:1196] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/2207e52aa5bf453996632772fa3e3546
I20260809 06:55:31.332222 26292 ts_tablet_manager.cc:1939] T 2207e52aa5bf453996632772fa3e3546 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Deleting consensus metadata
I20260809 06:55:31.334340 25750 catalog_manager.cc:4841] TS 630aa5d2bbbb40b38cbbab5c0575a4c6 (127.10.205.65:42363): tablet 2207e52aa5bf453996632772fa3e3546 (table test-table [id=97f69144643543f9b58d66603f7e3fea]) successfully deleted
I20260809 06:55:31.339558 26261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.299937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48836 (local address 127.10.205.65:42363)
0809 06:55:31.300181 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:31.300190 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:31.313504 (+ 13314us) server_negotiation.cc:407] Connection header received
0809 06:55:31.315879 (+ 2375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:31.315885 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:31.315967 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:31.316041 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:31.318273 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.319454 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.325195 (+ 5741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.326431 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.326565 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.332692 (+ 6127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:31.332718 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:31.332736 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:31.332811 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:31.336737 (+ 3926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:31.337587 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:31.337593 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:31.337596 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:31.337753 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:31.338169 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:31.338172 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:31.338174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:31.338498 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:31.338711 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:31.339065 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 06:55:31.339263 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 06:55:31.340214 25957 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:31.459662 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 25829
I20260809 06:55:31.480937 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 25972
Aug 09 06:55:31 dist-test-slave-0b58 krb5kdc[25717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:55:31.501223 26262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.481789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45240 (local address 127.10.205.66:36405)
0809 06:55:31.481958 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:31.481962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:31.481980 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:55:31.482104 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:31.482107 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:31.482174 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:31.482264 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:31.483563 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.484473 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.485844 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.486238 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.486334 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.495219 (+ 8885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:31.495288 (+ 69us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:31.495313 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:31.495356 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:31.498378 (+ 3022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:31.499140 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:31.499150 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:31.499154 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:31.499293 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:31.499731 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:31.499735 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:31.499737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:31.500239 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:31.500506 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:31.500784 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 06:55:31.500956 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:55:31.501992 26098 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:31.593304 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 25972
I20260809 06:55:31.613200 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 26110
Aug 09 06:55:31 dist-test-slave-0b58 krb5kdc[25717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:55:31.628149 26264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:31.614014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36880 (local address 127.10.205.67:34085)
0809 06:55:31.614218 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:31.614224 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:31.614244 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:55:31.614384 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:31.614388 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:31.614463 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:31.614579 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:31.615775 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.616576 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.617785 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:31.618158 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:31.618259 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:31.622733 (+ 4474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:31.622750 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:31.622767 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:31.622802 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:31.625508 (+ 2706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:31.626150 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:31.626157 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:31.626159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:31.626322 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:31.626647 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:31.626650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:31.626652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:31.627083 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:31.627322 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:31.627595 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 06:55:31.627775 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:55:31.628862 26239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:31.720577 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 26110
I20260809 06:55:31.740342 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 25731
I20260809 06:55:31.741499 25795 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:31.851979 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 25731
I20260809 06:55:31.877189 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:34639
--webserver_interface=127.10.205.126
--webserver_port=44197
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:34639
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:32.222764 26299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:32.223091 26299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:32.223286 26299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:32.233773 26299 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:55:32.233922 26299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:32.234012 26299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:32.234097 26299 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:55:32.234157 26299 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:55:32.244382 26299 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:34639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:34639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=44197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:32.245664 26299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:32.246951 26299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:32.274237 26308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:32.274170 26306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:32.274214 26305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:32.274935 26299 server_base.cc:1034] running on GCE node
I20260809 06:55:32.275950 26299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:32.277667 26299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:32.278913 26299 hybrid_clock.cc:648] HybridClock initialized: now 1786258532278861 us; error 47 us; skew 500 ppm
I20260809 06:55:32.279330 26299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:32 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258532, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:32.287930 26299 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:55:32.289873 26299 webserver.cc:460] Webserver started at http://127.10.205.126:44197/ using document root <none> and password file <none>
I20260809 06:55:32.290688 26299 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:32.290866 26299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:32.297303 26299 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 06:55:32.300406 26315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:32.301882 26299 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:55:32.302100 26299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "fe584539bd0a42c89d3bf7b64f40698e"
format_stamp: "Formatted at 2026-08-09 06:55:29 on dist-test-slave-0b58"
server_key: "1f15e0106398898980b501f372985837"
server_key_iv: "b0d9eeff068f7c9479672cc1782fe01a"
server_key_version: "encryptionkey@0"
I20260809 06:55:32.303299 26299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:32.318814 26299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:32.322996 26299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:32.323294 26299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:32.343468 26299 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:34639
I20260809 06:55:32.343472 26367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:34639 every 8 connection(s)
I20260809 06:55:32.345153 26299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:55:32.346594 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 26299
I20260809 06:55:32.347694 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:42363
--local_ip_for_outbound_sockets=127.10.205.65
--tserver_master_addrs=127.10.205.126:34639
--webserver_port=33867
--webserver_interface=127.10.205.65
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:55:32.355683 26368 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:55:32.360675 26368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Bootstrap starting.
I20260809 06:55:32.381484 26368 log.cc:824] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:32.394382 26368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:55:32.394958 26368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Bootstrap complete.
I20260809 06:55:32.404718 26368 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } }
I20260809 06:55:32.405620 26368 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe584539bd0a42c89d3bf7b64f40698e, State: Initialized, Role: FOLLOWER
I20260809 06:55:32.406275 26368 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } }
I20260809 06:55:32.406519 26368 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:55:32.406664 26368 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:55:32.406865 26368 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 1 FOLLOWER]: Advancing to term 2
I20260809 06:55:32.411224 26368 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } }
I20260809 06:55:32.411788 26368 leader_election.cc:302] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe584539bd0a42c89d3bf7b64f40698e; no voters:
I20260809 06:55:32.412457 26368 leader_election.cc:288] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 06:55:32.412616 26372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 2 FOLLOWER]: Leader election won for term 2
I20260809 06:55:32.414000 26372 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 2 LEADER]: Becoming Leader. State: Replica: fe584539bd0a42c89d3bf7b64f40698e, State: Running, Role: LEADER
I20260809 06:55:32.414569 26372 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } }
I20260809 06:55:32.414928 26368 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:55:32.417127 26374 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe584539bd0a42c89d3bf7b64f40698e. Latest consensus state: current_term: 2 leader_uuid: "fe584539bd0a42c89d3bf7b64f40698e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } } }
I20260809 06:55:32.417549 26374 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:32.418097 26373 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fe584539bd0a42c89d3bf7b64f40698e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } } }
I20260809 06:55:32.418398 26373 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:32.428900 26379 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:55:32.438228 26379 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:55:32.439808 26379 catalog_manager.cc:1259] Loaded cluster ID: 6243e2ce4c1646049b18b552fabedfbc
I20260809 06:55:32.439993 26379 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:55:32.443255 26379 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 06:55:32.462301 26379 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 06:55:32.475226 26379 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:55:32.477128 26379 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Loaded TSK: 0
I20260809 06:55:32.478853 26379 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 06:55:32.726516 26370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:32.726859 26370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:32.727025 26370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:32.734894 26370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:32.735059 26370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:32.735255 26370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:55:32.745638 26370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:42363
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=33867
--tserver_master_addrs=127.10.205.126:34639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:32.747076 26370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:32.748621 26370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:32.763967 26398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:32.764308 26400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:32.764585 26397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:32.765053 26370 server_base.cc:1034] running on GCE node
I20260809 06:55:32.765872 26370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:32.766914 26370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:32.768183 26370 hybrid_clock.cc:648] HybridClock initialized: now 1786258532768093 us; error 56 us; skew 500 ppm
I20260809 06:55:32.768556 26370 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:32 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258532, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:32.771842 26370 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:55:32.773500 26370 webserver.cc:460] Webserver started at http://127.10.205.65:33867/ using document root <none> and password file <none>
I20260809 06:55:32.774268 26370 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:32.774427 26370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:32.780417 26370 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 06:55:32.783278 26407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:32.784801 26370 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:55:32.784979 26370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6"
format_stamp: "Formatted at 2026-08-09 06:55:29 on dist-test-slave-0b58"
server_key: "2d8a9c7089f8db74e65d0ee92da25419"
server_key_iv: "ee6b03b6df4d10257cd90b4f02ce1314"
server_key_version: "encryptionkey@0"
I20260809 06:55:32.785995 26370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:32.810777 26370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:32.815165 26370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:32.815400 26370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:32.816540 26370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:32.817812 26370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:32.817902 26370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:32.817981 26370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:32.818033 26370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:32.850543 26370 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:42363
I20260809 06:55:32.850630 26522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:42363 every 8 connection(s)
I20260809 06:55:32.852027 26370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:55:32.860100 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 26370
I20260809 06:55:32.860877 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:36405
--local_ip_for_outbound_sockets=127.10.205.66
--tserver_master_addrs=127.10.205.126:34639
--webserver_port=36109
--webserver_interface=127.10.205.66
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:55:32 dist-test-slave-0b58 krb5kdc[25717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258532, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:32.877756 26525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:32.855160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:58523 (local address 127.10.205.126:34639)
0809 06:55:32.855734 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:32.855746 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:32.856475 (+ 729us) server_negotiation.cc:407] Connection header received
0809 06:55:32.858597 (+ 2122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:32.858610 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:32.858921 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:32.859210 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:32.860801 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:32.862863 (+ 2062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:32.864636 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:32.865715 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:32.865906 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:32.869721 (+ 3815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:32.869734 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:32.869754 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:32.869806 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:32.873137 (+ 3331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:32.874086 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:32.874093 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:32.874098 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:32.874267 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:32.874738 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:32.874741 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:32.874743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:32.875208 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:32.875344 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:32.876446 (+ 1102us) server_negotiation.cc:299] Negotiation successful
0809 06:55:32.876752 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":257,"threads_started":1}
I20260809 06:55:32.878192 26526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:32.855420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:58523)
0809 06:55:32.856302 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:32.856353 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:32.858086 (+ 1733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:32.859333 (+ 1247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:32.859341 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:32.859877 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:32.860487 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:32.860507 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:32.863171 (+ 2664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:32.863175 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:32.864463 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:32.864476 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:32.865929 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:32.865934 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:32.866125 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:32.866833 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:32.866855 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:32.869415 (+ 2560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:32.873315 (+ 3900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:32.873326 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:32.873344 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:32.873964 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:32.874384 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:32.874391 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:32.874398 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:32.874634 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:32.875346 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:32.875357 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:32.875841 (+ 484us) client_negotiation.cc:769] Sending connection context
0809 06:55:32.876191 (+ 350us) client_negotiation.cc:240] Negotiation successful
0809 06:55:32.876820 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":362,"threads_started":1}
I20260809 06:55:32.881146 26523 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34639
I20260809 06:55:32.881441 26523 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:32.882189 26523 heartbeater.cc:511] Master 127.10.205.126:34639 requested a full tablet report, sending...
I20260809 06:55:32.884788 26332 ts_manager.cc:194] Registered new tserver with Master: 630aa5d2bbbb40b38cbbab5c0575a4c6 (127.10.205.65:42363)
I20260809 06:55:32.887008 26332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:58523
W20260809 06:55:33.202555 26527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:33.202852 26527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:33.202960 26527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:33.210137 26527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:33.210253 26527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:33.210393 26527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:55:33.220005 26527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:36405
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=36109
--tserver_master_addrs=127.10.205.126:34639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:33.221382 26527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:33.222880 26527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:33.235715 26532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:33.235805 26535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:33.235767 26533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:33.236564 26527 server_base.cc:1034] running on GCE node
I20260809 06:55:33.237110 26527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:33.237998 26527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:33.239190 26527 hybrid_clock.cc:648] HybridClock initialized: now 1786258533239139 us; error 40 us; skew 500 ppm
I20260809 06:55:33.239475 26527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:33 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258533, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:33.242542 26527 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:55:33.244026 26527 webserver.cc:460] Webserver started at http://127.10.205.66:36109/ using document root <none> and password file <none>
I20260809 06:55:33.244726 26527 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:33.244885 26527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:33.250067 26527 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 06:55:33.252717 26543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:33.254022 26527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:55:33.254195 26527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "a026fd6bbc2f4280b07dcbefc73e289f"
format_stamp: "Formatted at 2026-08-09 06:55:30 on dist-test-slave-0b58"
server_key: "b0fdf916f08de28522259a71242e4a53"
server_key_iv: "559d3bd88ba6e1e97bd13715ed7d45dc"
server_key_version: "encryptionkey@0"
I20260809 06:55:33.255172 26527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:33.278237 26527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:33.282864 26527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:33.283161 26527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:33.284178 26527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:33.285517 26527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:33.285643 26527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:33.285758 26527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:33.285847 26527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:33.318717 26527 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:36405
I20260809 06:55:33.318809 26658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:36405 every 8 connection(s)
I20260809 06:55:33.320147 26527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:55:33.324893 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 26527
I20260809 06:55:33.325492 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:34085
--local_ip_for_outbound_sockets=127.10.205.67
--tserver_master_addrs=127.10.205.126:34639
--webserver_port=33895
--webserver_interface=127.10.205.67
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:55:33 dist-test-slave-0b58 krb5kdc[25717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258533, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:33.341809 26525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:33.322611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:41809 (local address 127.10.205.126:34639)
0809 06:55:33.322842 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:33.322849 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:33.324010 (+ 1161us) server_negotiation.cc:407] Connection header received
0809 06:55:33.325842 (+ 1832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:33.325847 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:33.325945 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:33.326049 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:33.327562 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.328350 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.329906 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.330404 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.330564 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:33.334975 (+ 4411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:33.334982 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:33.334989 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:33.335033 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:33.338389 (+ 3356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:33.339336 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:33.339341 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:33.339343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:33.339477 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:33.339986 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:33.339989 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:33.339991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:33.340345 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:33.340460 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:33.341354 (+ 894us) server_negotiation.cc:299] Negotiation successful
0809 06:55:33.341536 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 06:55:33.343515 26661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:33.323144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:41809)
0809 06:55:33.323862 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:33.323899 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:33.325511 (+ 1612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:33.326312 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:33.326321 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:33.326838 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:33.327391 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:33.327409 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.328510 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.328514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:33.329755 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:33.329767 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.330686 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.330697 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:33.331059 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:33.331812 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:33.331847 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:33.334734 (+ 2887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:33.338528 (+ 3794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:33.338541 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:33.338563 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:33.339194 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:33.339589 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:33.339597 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:33.339603 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:33.339865 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:33.340466 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:33.340477 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:33.340943 (+ 466us) client_negotiation.cc:769] Sending connection context
0809 06:55:33.341291 (+ 348us) client_negotiation.cc:240] Negotiation successful
0809 06:55:33.341939 (+ 648us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":273,"threads_started":1}
I20260809 06:55:33.345363 26659 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34639
I20260809 06:55:33.345690 26659 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:33.346675 26659 heartbeater.cc:511] Master 127.10.205.126:34639 requested a full tablet report, sending...
I20260809 06:55:33.348510 26332 ts_manager.cc:194] Registered new tserver with Master: a026fd6bbc2f4280b07dcbefc73e289f (127.10.205.66:36405)
I20260809 06:55:33.349712 26332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:41809
W20260809 06:55:33.674091 26662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:33.674458 26662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:33.674613 26662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:33.681831 26662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:33.681989 26662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:33.682157 26662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:55:33.692555 26662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:34085
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=33895
--tserver_master_addrs=127.10.205.126:34639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:33.693987 26662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:33.695397 26662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:33.708897 26671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:33.708953 26668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:33.709482 26667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:33.709761 26662 server_base.cc:1034] running on GCE node
I20260809 06:55:33.710414 26662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:33.711374 26662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:33.712592 26662 hybrid_clock.cc:648] HybridClock initialized: now 1786258533712545 us; error 43 us; skew 500 ppm
I20260809 06:55:33.712903 26662 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:33 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258533, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:33.716114 26662 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:55:33.717554 26662 webserver.cc:460] Webserver started at http://127.10.205.67:33895/ using document root <none> and password file <none>
I20260809 06:55:33.718232 26662 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:33.718350 26662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:33.723536 26662 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 06:55:33.726217 26678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:33.727582 26662 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:55:33.727720 26662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "43aabe41c07a43948348e1b6672d7515"
format_stamp: "Formatted at 2026-08-09 06:55:30 on dist-test-slave-0b58"
server_key: "59ad0196816c745beca26f0469836ddd"
server_key_iv: "1cda199b5b4dab380b1ded972afd6a0d"
server_key_version: "encryptionkey@0"
I20260809 06:55:33.728786 26662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:33.756240 26662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:33.760618 26662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:33.760856 26662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:33.761821 26662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:33.763164 26662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:33.763257 26662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:33.763335 26662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:33.763388 26662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:33.796938 26662 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:34085
I20260809 06:55:33.796978 26801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:34085 every 8 connection(s)
I20260809 06:55:33.798405 26662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:55:33.801170 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 26662
Aug 09 06:55:33 dist-test-slave-0b58 krb5kdc[25717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258533, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:33.817402 26806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:33.802556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48256 (local address 127.10.205.126:34639)
0809 06:55:33.803198 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:33.803205 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:33.803223 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:55:33.803284 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:33.803289 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:33.803366 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:33.803473 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:33.804991 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.805754 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.807260 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.807724 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.807855 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:33.810891 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:33.810897 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:33.810900 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:33.810930 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:33.813987 (+ 3057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:33.814952 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:33.814956 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:33.814974 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:33.815168 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:33.815657 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:33.815661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:33.815663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:33.816059 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:33.816357 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:33.816715 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 06:55:33.816934 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":527,"thread_start_us":368,"threads_started":1}
I20260809 06:55:33.820055 26525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:33.800882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:42809 (local address 127.10.205.126:34639)
0809 06:55:33.801062 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:33.801066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:33.802644 (+ 1578us) server_negotiation.cc:407] Connection header received
0809 06:55:33.804849 (+ 2205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:33.804855 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:33.804938 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:33.805038 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:33.806490 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.807315 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.809010 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.809426 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.809570 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:33.813298 (+ 3728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:33.813308 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:33.813312 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:33.813352 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:33.816835 (+ 3483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:33.817796 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:33.817801 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:33.817804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:33.817921 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:33.818357 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:33.818362 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:33.818365 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:33.818614 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:33.818762 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:33.819505 (+ 743us) server_negotiation.cc:299] Negotiation successful
0809 06:55:33.819714 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":57}
I20260809 06:55:33.821107 26804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:33.801535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:42809)
0809 06:55:33.802475 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:33.802529 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:33.804596 (+ 2067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:33.805266 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:33.805274 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:33.805753 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:33.806329 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:33.806346 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.807464 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.807468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:33.808841 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:33.808853 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.809657 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.809664 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:33.809899 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:33.810522 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:33.810543 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:33.813072 (+ 2529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:33.816978 (+ 3906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:33.816987 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:33.817018 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:33.817665 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:33.818032 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:33.818037 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:33.818041 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:33.818240 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:33.818756 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:33.818764 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:33.819139 (+ 375us) client_negotiation.cc:769] Sending connection context
0809 06:55:33.819403 (+ 264us) client_negotiation.cc:240] Negotiation successful
0809 06:55:33.819968 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":414,"threads_started":1}
I20260809 06:55:33.822561 26802 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34639
I20260809 06:55:33.822883 26802 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:33.823649 26802 heartbeater.cc:511] Master 127.10.205.126:34639 requested a full tablet report, sending...
I20260809 06:55:33.825131 26332 ts_manager.cc:194] Registered new tserver with Master: 43aabe41c07a43948348e1b6672d7515 (127.10.205.67:34085)
I20260809 06:55:33.825917 26332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:42809
I20260809 06:55:33.832414 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:55:33.839219 26525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:33.833346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48272 (local address 127.10.205.126:34639)
0809 06:55:33.833530 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:33.833538 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:33.834052 (+ 514us) server_negotiation.cc:407] Connection header received
0809 06:55:33.834222 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:33.834226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:33.834364 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:33.834478 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:55:33.834980 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.835782 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.837220 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.837616 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.837713 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:33.838159 (+ 446us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:55:33.838656 (+ 497us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:55:33.838762 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:33.838862 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 06:55:33.838926 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:55:33.840118 26332 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:48272:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:55:33.847297 26332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:55:33.882238 26814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:33.860039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:34085 (local address 127.0.0.1:36892)
0809 06:55:33.872198 (+ 12159us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:33.872277 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:33.872503 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:33.874954 (+ 2451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:33.874961 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:33.874989 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:33.875463 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:33.875481 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.877460 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.877465 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:33.879618 (+ 2153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:33.879630 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.881215 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.881221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:33.881416 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:33.881476 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 06:55:33.881610 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 06:55:33.881845 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11876,"thread_start_us":12961,"threads_started":1}
I20260809 06:55:33.882972 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:33.860218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36892 (local address 127.10.205.67:34085)
0809 06:55:33.874228 (+ 14010us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:33.874234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:33.874293 (+ 59us) server_negotiation.cc:407] Connection header received
0809 06:55:33.874405 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:33.874412 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:33.874695 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:33.875683 (+ 988us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:33.876006 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.877250 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.879790 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.881002 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.881148 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:33.881416 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:33.882515 (+ 1099us) server_negotiation.cc:299] Negotiation successful
0809 06:55:33.882705 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13840,"thread_start_us":13690,"threads_started":1}
I20260809 06:55:33.883445 26813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:33.860157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:42363 (local address 127.0.0.1:48844)
0809 06:55:33.873373 (+ 13216us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:33.873400 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:33.873570 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:33.875553 (+ 1983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:33.875557 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:33.875581 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:33.876002 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:33.876012 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.878018 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.878023 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:33.880500 (+ 2477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:33.880514 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.882570 (+ 2056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.882579 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:33.882746 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:33.882776 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 06:55:33.882851 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 06:55:33.882996 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13034,"mutex_wait_us":83,"thread_start_us":11586,"threads_started":1}
I20260809 06:55:33.883903 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:33.860812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:36405 (local address 127.0.0.1:45244)
0809 06:55:33.874179 (+ 13367us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:33.874198 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:33.874332 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:33.875682 (+ 1350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:33.875687 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:33.875712 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:33.876296 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:33.876311 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.878178 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.878198 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:33.880329 (+ 2131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:33.880341 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.883050 (+ 2709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.883056 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:33.883252 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:33.883289 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 06:55:33.883373 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 06:55:33.883527 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13238,"mutex_wait_us":14,"thread_start_us":13107,"threads_started":1}
I20260809 06:55:33.884047 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:33.860892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48844 (local address 127.10.205.65:42363)
0809 06:55:33.874947 (+ 14055us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:33.874955 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:33.874984 (+ 29us) server_negotiation.cc:407] Connection header received
0809 06:55:33.875092 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:33.875099 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:33.875340 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:33.875546 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:33.876217 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.877847 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.880654 (+ 2807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.882060 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.882182 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:33.883375 (+ 1193us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:33.883448 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 06:55:33.883710 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13890,"thread_start_us":13725,"threads_started":1}
I20260809 06:55:33.884773 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:33.860855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45244 (local address 127.10.205.66:36405)
0809 06:55:33.873711 (+ 12856us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:33.873724 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:33.874329 (+ 605us) server_negotiation.cc:407] Connection header received
0809 06:55:33.874925 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:33.874934 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:33.875182 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:33.875392 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:33.876475 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.878017 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.880480 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:33.881944 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:33.882092 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:33.882307 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:33.884400 (+ 2093us) server_negotiation.cc:299] Negotiation successful
0809 06:55:33.884543 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12674,"thread_start_us":12546,"threads_started":1}
I20260809 06:55:33.887035 26732 tablet_service.cc:1467] Processing CreateTablet for tablet 310fe2fa06b241ee9abc5699dbeca901 (DEFAULT_TABLE table=test-table [id=cdd4e2cbe6c442bc9a13f024865ae047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:55:33.887766 26456 tablet_service.cc:1467] Processing CreateTablet for tablet 310fe2fa06b241ee9abc5699dbeca901 (DEFAULT_TABLE table=test-table [id=cdd4e2cbe6c442bc9a13f024865ae047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:55:33.888756 26732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 310fe2fa06b241ee9abc5699dbeca901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:33.889058 26456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 310fe2fa06b241ee9abc5699dbeca901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:33.889457 26591 tablet_service.cc:1467] Processing CreateTablet for tablet 310fe2fa06b241ee9abc5699dbeca901 (DEFAULT_TABLE table=test-table [id=cdd4e2cbe6c442bc9a13f024865ae047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:55:33.890504 26523 heartbeater.cc:503] Master 127.10.205.126:34639 was elected leader, sending a full tablet report...
I20260809 06:55:33.890739 26591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 310fe2fa06b241ee9abc5699dbeca901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:33.903026 26819 tablet_bootstrap.cc:492] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Bootstrap starting.
I20260809 06:55:33.904439 26821 tablet_bootstrap.cc:492] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515: Bootstrap starting.
I20260809 06:55:33.907169 26819 tablet_bootstrap.cc:654] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:33.907963 26821 tablet_bootstrap.cc:654] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:33.908959 26821 log.cc:824] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:33.908921 26819 log.cc:824] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:33.911062 26822 tablet_bootstrap.cc:492] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f: Bootstrap starting.
I20260809 06:55:33.911947 26821 tablet_bootstrap.cc:492] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515: No bootstrap required, opened a new log
I20260809 06:55:33.912247 26821 ts_tablet_manager.cc:1397] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 06:55:33.913429 26819 tablet_bootstrap.cc:492] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6: No bootstrap required, opened a new log
I20260809 06:55:33.913704 26819 ts_tablet_manager.cc:1397] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260809 06:55:33.914108 26822 tablet_bootstrap.cc:654] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:33.915396 26822 log.cc:824] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:33.918210 26822 tablet_bootstrap.cc:492] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f: No bootstrap required, opened a new log
I20260809 06:55:33.918490 26822 ts_tablet_manager.cc:1397] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 06:55:33.923225 26821 raft_consensus.cc:348] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } } peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } }
I20260809 06:55:33.923703 26821 raft_consensus.cc:374] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:33.923835 26821 raft_consensus.cc:729] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43aabe41c07a43948348e1b6672d7515, State: Initialized, Role: FOLLOWER
I20260809 06:55:33.924559 26821 consensus_queue.cc:260] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } } peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } }
I20260809 06:55:33.924432 26819 raft_consensus.cc:348] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } } peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } }
I20260809 06:55:33.924883 26819 raft_consensus.cc:374] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:33.925032 26819 raft_consensus.cc:729] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630aa5d2bbbb40b38cbbab5c0575a4c6, State: Initialized, Role: FOLLOWER
I20260809 06:55:33.925838 26819 consensus_queue.cc:260] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } } peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } }
I20260809 06:55:33.926035 26822 raft_consensus.cc:348] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } } peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } }
I20260809 06:55:33.926666 26822 raft_consensus.cc:374] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:33.926847 26822 raft_consensus.cc:729] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a026fd6bbc2f4280b07dcbefc73e289f, State: Initialized, Role: FOLLOWER
I20260809 06:55:33.927682 26802 heartbeater.cc:503] Master 127.10.205.126:34639 was elected leader, sending a full tablet report...
I20260809 06:55:33.928565 26821 ts_tablet_manager.cc:1428] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515: Time spent starting tablet: real 0.016s user 0.015s sys 0.001s
I20260809 06:55:33.928723 26819 ts_tablet_manager.cc:1428] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Time spent starting tablet: real 0.015s user 0.015s sys 0.001s
I20260809 06:55:33.929289 26822 consensus_queue.cc:260] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } } peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } }
I20260809 06:55:33.930408 26659 heartbeater.cc:503] Master 127.10.205.126:34639 was elected leader, sending a full tablet report...
I20260809 06:55:33.931038 26822 ts_tablet_manager.cc:1428] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
W20260809 06:55:34.050109 26803 tablet.cc:2369] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:55:34.072396 26660 tablet.cc:2369] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:55:34.104598 26524 tablet.cc:2369] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:55:34.256863 26827 raft_consensus.cc:482] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:55:34.257203 26827 raft_consensus.cc:504] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } } peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } }
I20260809 06:55:34.259162 26827 leader_election.cc:288] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43aabe41c07a43948348e1b6672d7515 (127.10.205.67:34085), a026fd6bbc2f4280b07dcbefc73e289f (127.10.205.66:36405)
I20260809 06:55:34.263564 26828 raft_consensus.cc:482] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:55:34.263849 26828 raft_consensus.cc:504] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } } peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } }
I20260809 06:55:34.265730 26828 leader_election.cc:288] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43aabe41c07a43948348e1b6672d7515 (127.10.205.67:34085), 630aa5d2bbbb40b38cbbab5c0575a4c6 (127.10.205.65:42363)
I20260809 06:55:34.267145 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:34.259614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:51363 (local address 127.10.205.67:34085)
0809 06:55:34.259998 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:34.260004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:34.260702 (+ 698us) server_negotiation.cc:407] Connection header received
0809 06:55:34.260866 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:34.260871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:34.260951 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:34.261051 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:34.261762 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.262504 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.264657 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.265916 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.266078 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:34.266165 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:34.266724 (+ 559us) server_negotiation.cc:299] Negotiation successful
0809 06:55:34.266886 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231}
I20260809 06:55:34.267499 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:34.259739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:54169 (local address 127.10.205.66:36405)
0809 06:55:34.260188 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:34.260195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:34.260471 (+ 276us) server_negotiation.cc:407] Connection header received
0809 06:55:34.260698 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:34.260705 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:34.260790 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:34.260884 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:34.261565 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.262353 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.264771 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.266138 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.266339 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:34.266415 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:34.266921 (+ 506us) server_negotiation.cc:299] Negotiation successful
0809 06:55:34.267241 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284}
I20260809 06:55:34.268157 26830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:34.259598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:34085 (local address 127.10.205.65:51363)
0809 06:55:34.260569 (+ 971us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:34.260583 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:34.260724 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:34.261087 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:34.261090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:34.261175 (+ 85us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:34.261590 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:34.261602 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.262650 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.262653 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:34.264494 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:34.264510 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.266328 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.266334 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:34.266511 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:34.266557 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 06:55:34.267486 (+ 929us) client_negotiation.cc:240] Negotiation successful
0809 06:55:34.267725 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":847,"mutex_wait_us":32,"spinlock_wait_cycles":26880,"thread_start_us":642,"threads_started":1}
I20260809 06:55:34.268420 26829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:34.259481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:36405 (local address 127.10.205.65:54169)
0809 06:55:34.260339 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:34.260368 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:34.260547 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:34.260912 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:34.260917 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:34.260941 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:34.261412 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:34.261424 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.262486 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.262491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:34.264598 (+ 2107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:34.264613 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.266561 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.266566 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:34.266741 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:34.266771 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 06:55:34.267830 (+ 1059us) client_negotiation.cc:240] Negotiation successful
0809 06:55:34.267963 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"mutex_wait_us":23,"thread_start_us":415,"threads_started":1}
I20260809 06:55:34.269567 26753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "310fe2fa06b241ee9abc5699dbeca901" candidate_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43aabe41c07a43948348e1b6672d7515" is_pre_election: true
I20260809 06:55:34.269771 26612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "310fe2fa06b241ee9abc5699dbeca901" candidate_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" is_pre_election: true
I20260809 06:55:34.270066 26753 raft_consensus.cc:2454] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630aa5d2bbbb40b38cbbab5c0575a4c6 in term 0.
I20260809 06:55:34.270395 26612 raft_consensus.cc:2454] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630aa5d2bbbb40b38cbbab5c0575a4c6 in term 0.
I20260809 06:55:34.270865 26408 leader_election.cc:302] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43aabe41c07a43948348e1b6672d7515, 630aa5d2bbbb40b38cbbab5c0575a4c6; no voters:
I20260809 06:55:34.271740 26827 raft_consensus.cc:2781] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:55:34.271924 26827 raft_consensus.cc:482] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:55:34.272030 26827 raft_consensus.cc:3037] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:34.275087 26827 raft_consensus.cc:504] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } } peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } }
I20260809 06:55:34.275903 26827 leader_election.cc:288] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [CANDIDATE]: Term 1 election: Requested vote from peers 43aabe41c07a43948348e1b6672d7515 (127.10.205.67:34085), a026fd6bbc2f4280b07dcbefc73e289f (127.10.205.66:36405)
I20260809 06:55:34.276453 26612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "310fe2fa06b241ee9abc5699dbeca901" candidate_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a026fd6bbc2f4280b07dcbefc73e289f"
I20260809 06:55:34.276691 26612 raft_consensus.cc:3037] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:34.276654 26753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "310fe2fa06b241ee9abc5699dbeca901" candidate_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43aabe41c07a43948348e1b6672d7515"
I20260809 06:55:34.276880 26753 raft_consensus.cc:3037] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:34.279654 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:34.266969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:36867 (local address 127.10.205.65:42363)
0809 06:55:34.267145 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:34.267150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:34.272285 (+ 5135us) server_negotiation.cc:407] Connection header received
0809 06:55:34.272596 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:34.272600 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:34.272673 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:34.272781 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:34.273496 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.274585 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.277173 (+ 2588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.278422 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.278553 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:34.278629 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:34.279253 (+ 624us) server_negotiation.cc:299] Negotiation successful
0809 06:55:34.279404 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 06:55:34.280138 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:34.266698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:42945 (local address 127.10.205.67:34085)
0809 06:55:34.267444 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:34.267449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:34.271959 (+ 4510us) server_negotiation.cc:407] Connection header received
0809 06:55:34.272282 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:34.272288 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:34.272363 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:34.272429 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:34.273249 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.274405 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.277218 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.278821 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.278983 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:34.279068 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:34.279699 (+ 631us) server_negotiation.cc:299] Negotiation successful
0809 06:55:34.279843 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":2181,"threads_started":1}
I20260809 06:55:34.280558 26831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:34.266460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:42363 (local address 127.10.205.66:36867)
0809 06:55:34.272165 (+ 5705us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:34.272185 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:34.272390 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:34.272815 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:34.272820 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:34.272862 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:34.273326 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:34.273339 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.274716 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.274729 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:34.276955 (+ 2226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:34.276974 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.278868 (+ 1894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.278877 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:34.279051 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:34.279087 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:55:34.279819 (+ 732us) client_negotiation.cc:240] Negotiation successful
0809 06:55:34.279968 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5568,"mutex_wait_us":83,"thread_start_us":4953,"threads_started":1}
I20260809 06:55:34.280669 26612 raft_consensus.cc:2454] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630aa5d2bbbb40b38cbbab5c0575a4c6 in term 1.
I20260809 06:55:34.281229 26832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:34.266059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:34085 (local address 127.10.205.66:42945)
0809 06:55:34.271849 (+ 5790us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:34.271873 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:34.272085 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:34.272656 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:34.272661 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:34.272685 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:34.273106 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:34.273116 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.274550 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.274556 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:34.277000 (+ 2444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:34.277016 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.279289 (+ 2273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.279295 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:34.279497 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:34.279530 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 06:55:34.280480 (+ 950us) client_negotiation.cc:240] Negotiation successful
0809 06:55:34.280846 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5602,"mutex_wait_us":111,"spinlock_wait_cycles":24448,"thread_start_us":5726,"threads_started":1}
I20260809 06:55:34.281155 26410 leader_election.cc:302] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630aa5d2bbbb40b38cbbab5c0575a4c6, a026fd6bbc2f4280b07dcbefc73e289f; no voters:
I20260809 06:55:34.281581 26827 raft_consensus.cc:2781] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:55:34.281837 26476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "310fe2fa06b241ee9abc5699dbeca901" candidate_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" is_pre_election: true
I20260809 06:55:34.282212 26827 raft_consensus.cc:686] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 1 LEADER]: Becoming Leader. State: Replica: 630aa5d2bbbb40b38cbbab5c0575a4c6, State: Running, Role: LEADER
I20260809 06:55:34.282123 26752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "310fe2fa06b241ee9abc5699dbeca901" candidate_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43aabe41c07a43948348e1b6672d7515" is_pre_election: true
I20260809 06:55:34.282716 26753 raft_consensus.cc:2454] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630aa5d2bbbb40b38cbbab5c0575a4c6 in term 1.
I20260809 06:55:34.282822 26827 consensus_queue.cc:237] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } } peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } }
I20260809 06:55:34.286922 26547 leader_election.cc:302] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a026fd6bbc2f4280b07dcbefc73e289f; no voters: 43aabe41c07a43948348e1b6672d7515, 630aa5d2bbbb40b38cbbab5c0575a4c6
I20260809 06:55:34.287355 26828 raft_consensus.cc:2726] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 06:55:34.288376 26331 catalog_manager.cc:5495] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 630aa5d2bbbb40b38cbbab5c0575a4c6 (127.10.205.65). New cstate: current_term: 1 leader_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 42363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 } health_report { overall_health: UNKNOWN } } }
I20260809 06:55:34.342887 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:34.337745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48860 (local address 127.10.205.65:42363)
0809 06:55:34.337928 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:34.337932 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:34.337950 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:55:34.338069 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:34.338072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:34.338156 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:34.338277 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:55:34.338617 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.339420 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.340818 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.341211 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.341317 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:34.341725 (+ 408us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:55:34.342264 (+ 539us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:55:34.342369 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:34.342468 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 06:55:34.342534 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 06:55:34.352205 26753 raft_consensus.cc:1261] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515 [term 1 FOLLOWER]: Refusing update from remote peer 630aa5d2bbbb40b38cbbab5c0575a4c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:55:34.352284 26612 raft_consensus.cc:1261] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [term 1 FOLLOWER]: Refusing update from remote peer 630aa5d2bbbb40b38cbbab5c0575a4c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:55:34.353184 26827 consensus_queue.cc:1035] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a026fd6bbc2f4280b07dcbefc73e289f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 36405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:55:34.353506 26834 consensus_queue.cc:1035] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43aabe41c07a43948348e1b6672d7515" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 34085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:55:34.365420 26836 mvcc.cc:205] Tried to move back new op lower bound from 7316514956696215552 to 7316514956427186176. Current Snapshot: MvccSnapshot[applied={T|T < 7316514956696215552}]
I20260809 06:55:34.382840 26332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:48272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:55:34.383133 26332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:48272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:55:34.386498 26332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Sending DeleteTablet for 3 replicas of tablet 310fe2fa06b241ee9abc5699dbeca901
I20260809 06:55:34.387722 26732 tablet_service.cc:1514] Processing DeleteTablet for tablet 310fe2fa06b241ee9abc5699dbeca901 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:55:34 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:36892
I20260809 06:55:34.387768 26456 tablet_service.cc:1514] Processing DeleteTablet for tablet 310fe2fa06b241ee9abc5699dbeca901 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:55:34 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:48844
I20260809 06:55:34.388403 26591 tablet_service.cc:1514] Processing DeleteTablet for tablet 310fe2fa06b241ee9abc5699dbeca901 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:55:34 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:45244
I20260809 06:55:34.388651 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 26370
I20260809 06:55:34.401027 26848 tablet_replica.cc:330] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f: stopping tablet replica
I20260809 06:55:34.401613 26847 tablet_replica.cc:330] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6: stopping tablet replica
I20260809 06:55:34.401613 26848 raft_consensus.cc:2229] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:55:34.402053 26847 raft_consensus.cc:2229] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:55:34.402192 26848 raft_consensus.cc:2258] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:55:34.402797 26847 raft_consensus.cc:2258] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:55:34.403978 26846 tablet_replica.cc:330] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515: stopping tablet replica
I20260809 06:55:34.404430 26846 raft_consensus.cc:2229] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:55:34.404968 26846 raft_consensus.cc:2258] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:55:34.405439 26847 ts_tablet_manager.cc:1905] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:55:34.405614 26848 ts_tablet_manager.cc:1905] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:55:34.409324 26846 ts_tablet_manager.cc:1905] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:55:34.413071 26848 ts_tablet_manager.cc:1918] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:55:34.413257 26848 log.cc:1196] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/310fe2fa06b241ee9abc5699dbeca901
I20260809 06:55:34.413861 26848 ts_tablet_manager.cc:1939] T 310fe2fa06b241ee9abc5699dbeca901 P a026fd6bbc2f4280b07dcbefc73e289f: Deleting consensus metadata
I20260809 06:55:34.414492 26847 ts_tablet_manager.cc:1918] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:55:34.414662 26847 log.cc:1196] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/310fe2fa06b241ee9abc5699dbeca901
I20260809 06:55:34.415330 26847 ts_tablet_manager.cc:1939] T 310fe2fa06b241ee9abc5699dbeca901 P 630aa5d2bbbb40b38cbbab5c0575a4c6: Deleting consensus metadata
I20260809 06:55:34.415868 26318 catalog_manager.cc:4841] TS a026fd6bbc2f4280b07dcbefc73e289f (127.10.205.66:36405): tablet 310fe2fa06b241ee9abc5699dbeca901 (table test-table [id=cdd4e2cbe6c442bc9a13f024865ae047]) successfully deleted
I20260809 06:55:34.418208 26319 catalog_manager.cc:4841] TS 630aa5d2bbbb40b38cbbab5c0575a4c6 (127.10.205.65:42363): tablet 310fe2fa06b241ee9abc5699dbeca901 (table test-table [id=cdd4e2cbe6c442bc9a13f024865ae047]) successfully deleted
I20260809 06:55:34.418747 26846 ts_tablet_manager.cc:1918] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:55:34.418934 26846 log.cc:1196] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/310fe2fa06b241ee9abc5699dbeca901
I20260809 06:55:34.419404 26846 ts_tablet_manager.cc:1939] T 310fe2fa06b241ee9abc5699dbeca901 P 43aabe41c07a43948348e1b6672d7515: Deleting consensus metadata
I20260809 06:55:34.420938 26316 catalog_manager.cc:4841] TS 43aabe41c07a43948348e1b6672d7515 (127.10.205.67:34085): tablet 310fe2fa06b241ee9abc5699dbeca901 (table test-table [id=cdd4e2cbe6c442bc9a13f024865ae047]) successfully deleted
I20260809 06:55:34.426999 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:34.389530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48868 (local address 127.10.205.65:42363)
0809 06:55:34.389732 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:34.389739 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:34.403263 (+ 13524us) server_negotiation.cc:407] Connection header received
0809 06:55:34.403494 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:34.403501 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:34.403603 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:34.403752 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:34.407469 (+ 3717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.408597 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.416087 (+ 7490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.416812 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.416984 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:34.420718 (+ 3734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:34.420739 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:34.420758 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:34.420811 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:34.424075 (+ 3264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:34.425005 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:34.425012 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:34.425014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:34.425146 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:34.425579 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:34.425582 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:34.425584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:34.425963 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:34.426250 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:34.426585 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 06:55:34.426763 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 06:55:34.427789 26518 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:34.530203 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 26370
I20260809 06:55:34.552575 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 26527
I20260809 06:55:34.567028 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:34.553444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45260 (local address 127.10.205.66:36405)
0809 06:55:34.553641 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:34.553645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:34.553663 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:55:34.553847 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:34.553851 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:34.553912 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:34.554004 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:34.555372 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.556080 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.557659 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.558055 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.558147 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:34.561211 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:34.561227 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:34.561244 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:34.561279 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:34.564199 (+ 2920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:34.565049 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:34.565057 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:34.565059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:34.565191 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:34.565541 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:34.565543 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:34.565546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:34.565915 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:34.566163 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:34.566448 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 06:55:34.566624 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 06:55:34.567796 26654 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:34.660923 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 26527
I20260809 06:55:34.681722 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 26662
I20260809 06:55:34.695259 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:34.682513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36902 (local address 127.10.205.67:34085)
0809 06:55:34.682687 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:34.682691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:34.682710 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:55:34.682879 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:34.682883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:34.682983 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:34.683071 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:34.684534 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.685218 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.686527 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:34.686945 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:34.687039 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:34.689854 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:34.689872 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:34.689889 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:34.689925 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:34.692753 (+ 2828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:34.693473 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:34.693480 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:34.693483 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:34.693621 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:34.693988 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:34.693991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:34.693993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:34.694351 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:34.694596 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:34.694811 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 06:55:34.694998 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 06:55:34.695928 26797 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:34.785359 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 26662
I20260809 06:55:34.804809 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 26299
I20260809 06:55:34.806079 26363 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:34.922425 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 26299
I20260809 06:55:34.948388 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:34639
--webserver_interface=127.10.205.126
--webserver_port=44197
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:34639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:35.296887 26854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:35.297204 26854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:35.297360 26854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:35.304804 26854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:55:35.304922 26854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:35.305045 26854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:35.305140 26854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:55:35.305233 26854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:55:35.315591 26854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:34639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:34639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=44197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:35.317104 26854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:35.318492 26854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:35.330556 26860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:35.330621 26859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:35.330595 26862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:35.331549 26854 server_base.cc:1034] running on GCE node
I20260809 06:55:35.332471 26854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:35.333948 26854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:35.335151 26854 hybrid_clock.cc:648] HybridClock initialized: now 1786258535335077 us; error 112 us; skew 500 ppm
I20260809 06:55:35.335621 26854 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:35 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258535, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:35.339417 26854 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:55:35.341012 26854 webserver.cc:460] Webserver started at http://127.10.205.126:44197/ using document root <none> and password file <none>
I20260809 06:55:35.341656 26854 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:35.341761 26854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:35.347508 26854 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260809 06:55:35.350335 26869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:35.351686 26854 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 06:55:35.351861 26854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "fe584539bd0a42c89d3bf7b64f40698e"
format_stamp: "Formatted at 2026-08-09 06:55:29 on dist-test-slave-0b58"
server_key: "1f15e0106398898980b501f372985837"
server_key_iv: "b0d9eeff068f7c9479672cc1782fe01a"
server_key_version: "encryptionkey@0"
I20260809 06:55:35.352967 26854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:35.381345 26854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:35.385615 26854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:35.385898 26854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:35.405345 26854 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:34639
I20260809 06:55:35.405369 26923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:34639 every 8 connection(s)
I20260809 06:55:35.406941 26854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:55:35.408565 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 26854
I20260809 06:55:35.409610 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:42363
--local_ip_for_outbound_sockets=127.10.205.65
--tserver_master_addrs=127.10.205.126:34639
--webserver_port=33867
--webserver_interface=127.10.205.65
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:55:35.416988 26924 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:55:35.422076 26924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Bootstrap starting.
I20260809 06:55:35.443332 26924 log.cc:824] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:35.460866 26924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:55:35.461489 26924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e: Bootstrap complete.
I20260809 06:55:35.470981 26924 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } }
I20260809 06:55:35.471927 26924 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe584539bd0a42c89d3bf7b64f40698e, State: Initialized, Role: FOLLOWER
I20260809 06:55:35.472694 26924 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } }
I20260809 06:55:35.472944 26924 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:55:35.473073 26924 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:55:35.473271 26924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 2 FOLLOWER]: Advancing to term 3
I20260809 06:55:35.477329 26924 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } }
I20260809 06:55:35.477835 26924 leader_election.cc:302] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe584539bd0a42c89d3bf7b64f40698e; no voters:
I20260809 06:55:35.478572 26924 leader_election.cc:288] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 06:55:35.478734 26928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 3 FOLLOWER]: Leader election won for term 3
I20260809 06:55:35.479808 26928 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [term 3 LEADER]: Becoming Leader. State: Replica: fe584539bd0a42c89d3bf7b64f40698e, State: Running, Role: LEADER
I20260809 06:55:35.480434 26928 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } }
I20260809 06:55:35.480809 26924 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:55:35.483237 26930 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe584539bd0a42c89d3bf7b64f40698e. Latest consensus state: current_term: 3 leader_uuid: "fe584539bd0a42c89d3bf7b64f40698e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } } }
I20260809 06:55:35.483646 26930 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:35.483294 26929 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "fe584539bd0a42c89d3bf7b64f40698e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe584539bd0a42c89d3bf7b64f40698e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34639 } } }
I20260809 06:55:35.483927 26929 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe584539bd0a42c89d3bf7b64f40698e [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:35.484899 26935 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:55:35.502115 26935 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:55:35.504717 26935 catalog_manager.cc:1259] Loaded cluster ID: 6243e2ce4c1646049b18b552fabedfbc
I20260809 06:55:35.504962 26935 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 06:55:35.507892 26935 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f9c5e1779ad google::LogMessage::Fail() at ??:0
@ 0x7f9c5e17a88a google::LogMessage::SendToLog() at ??:0
@ 0x7f9c5e1774de google::LogMessage::Flush() at ??:0
I20260809 06:55:35.518177 26945 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f9c5e178a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9c73baa512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f9c73ba7976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9c73c2f610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f9c73c2f439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9c60dc3345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9c60dc691c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f9c60dc6799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9c60da1eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9c6407b6db start_thread at ??:0
@ 0x7f9c5d01161f clone at ??:0
W20260809 06:55:35.806141 26926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:35.806507 26926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:35.806684 26926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:35.814291 26926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:35.814484 26926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:35.814657 26926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:55:35.824971 26926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:42363
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=33867
--tserver_master_addrs=127.10.205.126:34639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:35.826433 26926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:35.827889 26926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:35.841557 26966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:35.841593 26970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:35.841528 26967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:35.842727 26926 server_base.cc:1034] running on GCE node
I20260809 06:55:35.843436 26926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:35.844416 26926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:35.845655 26926 hybrid_clock.cc:648] HybridClock initialized: now 1786258535845613 us; error 53 us; skew 500 ppm
I20260809 06:55:35.845975 26926 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:35 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258535, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:35.849090 26926 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:55:35.850673 26926 webserver.cc:460] Webserver started at http://127.10.205.65:33867/ using document root <none> and password file <none>
I20260809 06:55:35.851380 26926 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:35.851528 26926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:35.857131 26926 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:55:35.859872 26977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:35.861248 26926 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:55:35.861433 26926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "630aa5d2bbbb40b38cbbab5c0575a4c6"
format_stamp: "Formatted at 2026-08-09 06:55:29 on dist-test-slave-0b58"
server_key: "2d8a9c7089f8db74e65d0ee92da25419"
server_key_iv: "ee6b03b6df4d10257cd90b4f02ce1314"
server_key_version: "encryptionkey@0"
I20260809 06:55:35.862504 26926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:35.897394 26926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:35.901916 26926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:35.902225 26926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:35.903326 26926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:35.904824 26926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:35.904960 26926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:35.905086 26926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:35.905172 26926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:35.940508 26926 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:42363
I20260809 06:55:35.940593 27097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:42363 every 8 connection(s)
I20260809 06:55:35.942050 26926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:55:35.942593 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 26926
I20260809 06:55:35.943434 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:36405
--local_ip_for_outbound_sockets=127.10.205.66
--tserver_master_addrs=127.10.205.126:34639
--webserver_port=36109
--webserver_interface=127.10.205.66
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:55:35.947866 27100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:35.945550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:38609)
0809 06:55:35.946462 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:35.946729 (+ 267us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":294,"threads_started":1}
W20260809 06:55:35.948539 27098 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:34639 (0 consecutive failures): Network error: Failed to ping master at 127.10.205.126:34639: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
I20260809 06:55:35.949560 27100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:35.949075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:34261)
0809 06:55:35.949282 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:35.949380 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 06:55:35.950634 27100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:35.950183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:38155)
0809 06:55:35.950352 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:35.950455 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 06:55:35.950917 27098 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 06:55:36.295858 27101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:36.296176 27101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:36.296300 27101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:36.303637 27101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:36.303759 27101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:36.303872 27101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:55:36.313855 27101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:36405
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=36109
--tserver_master_addrs=127.10.205.126:34639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:36.315165 27101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:36.316617 27101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:36.330253 27106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:36.330263 27109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:36.331102 27101 server_base.cc:1034] running on GCE node
W20260809 06:55:36.331319 27107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:36.332018 27101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:36.333122 27101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:36.334353 27101 hybrid_clock.cc:648] HybridClock initialized: now 1786258536334311 us; error 38 us; skew 500 ppm
I20260809 06:55:36.334695 27101 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:36 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258536, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:36.337971 27101 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:55:36.339388 27101 webserver.cc:460] Webserver started at http://127.10.205.66:36109/ using document root <none> and password file <none>
I20260809 06:55:36.340094 27101 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:36.340240 27101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:36.345676 27101 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 06:55:36.348412 27118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:36.349783 27101 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 06:55:36.349961 27101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "a026fd6bbc2f4280b07dcbefc73e289f"
format_stamp: "Formatted at 2026-08-09 06:55:30 on dist-test-slave-0b58"
server_key: "b0fdf916f08de28522259a71242e4a53"
server_key_iv: "559d3bd88ba6e1e97bd13715ed7d45dc"
server_key_version: "encryptionkey@0"
I20260809 06:55:36.350970 27101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:36.403980 27101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:36.408109 27101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:36.408469 27101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:36.409533 27101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:36.410898 27101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:36.411022 27101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:36.411150 27101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:36.411233 27101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:36.445150 27101 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:36405
I20260809 06:55:36.445252 27236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:36405 every 8 connection(s)
I20260809 06:55:36.446672 27101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:55:36.451553 27239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:36.449753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:46153)
0809 06:55:36.450468 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:36.450694 (+ 226us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":260,"threads_started":1}
W20260809 06:55:36.452338 27237 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:34639 (0 consecutive failures): Network error: Failed to ping master at 127.10.205.126:34639: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
I20260809 06:55:36.453161 27239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:36.452851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:51469)
0809 06:55:36.452985 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:36.453056 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 06:55:36.453994 27239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:36.453713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:52097)
0809 06:55:36.453825 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:36.453895 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 06:55:36.454255 27237 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 06:55:36.455603 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 27101
I20260809 06:55:36.456228 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:34085
--local_ip_for_outbound_sockets=127.10.205.67
--tserver_master_addrs=127.10.205.126:34639
--webserver_port=33895
--webserver_interface=127.10.205.67
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:42357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:36.801422 27240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:36.801730 27240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:36.801827 27240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:36.809338 27240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:36.809468 27240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:36.809607 27240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:55:36.819357 27240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:42357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:34085
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=33895
--tserver_master_addrs=127.10.205.126:34639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:36.820772 27240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:36.822126 27240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:36.835754 27246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:36.836553 27240 server_base.cc:1034] running on GCE node
W20260809 06:55:36.836664 27245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:36.836819 27248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:36.837675 27240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:36.838681 27240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:36.839876 27240 hybrid_clock.cc:648] HybridClock initialized: now 1786258536839830 us; error 37 us; skew 500 ppm
I20260809 06:55:36.840200 27240 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:36 dist-test-slave-0b58 krb5kdc[25717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258536, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:36.843441 27240 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:55:36.845001 27240 webserver.cc:460] Webserver started at http://127.10.205.67:33895/ using document root <none> and password file <none>
I20260809 06:55:36.845748 27240 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:36.845894 27240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:36.851310 27240 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 06:55:36.854189 27255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:36.855650 27240 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:55:36.855822 27240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "43aabe41c07a43948348e1b6672d7515"
format_stamp: "Formatted at 2026-08-09 06:55:30 on dist-test-slave-0b58"
server_key: "59ad0196816c745beca26f0469836ddd"
server_key_iv: "1cda199b5b4dab380b1ded972afd6a0d"
server_key_version: "encryptionkey@0"
I20260809 06:55:36.856906 27240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:36.876461 27240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:36.881209 27240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:36.881526 27240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:36.882606 27240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:36.884006 27240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:36.884140 27240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:36.884279 27240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:36.884383 27240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 06:55:36.918788 27240 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:34085
I20260809 06:55:36.918879 27377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:34085 every 8 connection(s)
I20260809 06:55:36.920318 27240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:55:36.925266 27380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:36.923238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:45981)
0809 06:55:36.923969 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:36.924207 (+ 238us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":271,"threads_started":1}
W20260809 06:55:36.925908 27378 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:34639 (0 consecutive failures): Network error: Failed to ping master at 127.10.205.126:34639: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
I20260809 06:55:36.926807 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 27240
I20260809 06:55:36.926877 27380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:36.926467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:60879)
0809 06:55:36.926648 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:36.926737 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 06:55:36.927814 27380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:36.927469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:55119)
0809 06:55:36.927621 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:36.927704 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 06:55:36.928056 27378 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 06:55:36.952499 27382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:36.951478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:40915)
0809 06:55:36.952085 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:36.952201 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":348,"threads_started":1}
I20260809 06:55:37.455730 27383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:37.454879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:41325)
0809 06:55:37.455342 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:37.455465 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":204,"threads_started":1}
I20260809 06:55:37.929616 27384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:37.928713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:36797)
0809 06:55:37.929219 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:37.929373 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":234,"threads_started":1}
I20260809 06:55:37.954243 27385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:37.953506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:45571)
0809 06:55:37.953984 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:37.954075 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":217,"threads_started":1}
I20260809 06:55:38.457362 27386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:38.456642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:54365)
0809 06:55:38.457103 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:38.457201 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":246,"threads_started":1}
I20260809 06:55:38.931263 27387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:38.930555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:51673)
0809 06:55:38.931012 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:38.931093 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":228,"threads_started":1}
I20260809 06:55:38.956238 27388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:38.955412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:43453)
0809 06:55:38.955915 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:38.956016 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":260,"threads_started":1}
I20260809 06:55:39.459046 27389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:39.458304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:35021)
0809 06:55:39.458768 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:39.458870 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":234,"threads_started":1}
I20260809 06:55:39.932971 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:39.932199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:52973)
0809 06:55:39.932708 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:39.932796 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":294,"threads_started":1}
I20260809 06:55:39.958009 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:39.957245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:54251)
0809 06:55:39.957717 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:39.957815 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":253,"threads_started":1}
I20260809 06:55:40.460937 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:40.460133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:46405)
0809 06:55:40.460678 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:40.460761 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":293,"threads_started":1}
I20260809 06:55:40.935047 27393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:40.934037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:41113)
0809 06:55:40.934625 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:40.934737 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":273,"threads_started":1}
I20260809 06:55:40.959755 27394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:40.958982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:49961)
0809 06:55:40.959444 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:40.959527 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":252,"threads_started":1}
I20260809 06:55:41.463037 27395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:41.461961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:38207)
0809 06:55:41.462594 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:41.462764 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":277,"threads_started":1}
I20260809 06:55:41.937074 27396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:41.936346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:40147)
0809 06:55:41.936817 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:41.936903 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":239,"threads_started":1}
I20260809 06:55:41.961604 27397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:41.960848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:58707)
0809 06:55:41.961294 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:41.961390 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":221,"threads_started":1}
I20260809 06:55:42.464993 27398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:42.464095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:45583)
0809 06:55:42.464672 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:42.464782 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":291,"threads_started":1}
I20260809 06:55:42.938943 27399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:42.938134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:41757)
0809 06:55:42.938632 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:42.938731 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":268,"threads_started":1}
I20260809 06:55:42.963598 27400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:42.962590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:46339)
0809 06:55:42.963291 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:42.963379 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":294,"threads_started":1}
I20260809 06:55:43.466949 27401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:43.466003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:57593)
0809 06:55:43.466573 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:43.466720 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":275,"threads_started":1}
I20260809 06:55:43.941061 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:43.939999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:38211)
0809 06:55:43.940656 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:43.940760 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":312,"threads_started":1}
I20260809 06:55:43.965361 27403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:43.964663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:52303)
0809 06:55:43.965107 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:43.965195 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":231,"threads_started":1}
I20260809 06:55:44.468928 27404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:44.468030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:60357)
0809 06:55:44.468666 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:44.468753 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":339,"threads_started":1}
I20260809 06:55:44.943025 27406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:44.942140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:58293)
0809 06:55:44.942746 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:44.942859 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":317,"threads_started":1}
I20260809 06:55:44.967562 27407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:44.966532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:60581)
0809 06:55:44.967158 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:44.967282 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":339,"threads_started":1}
I20260809 06:55:45.470624 27408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:45.469883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:46347)
0809 06:55:45.470345 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:45.470433 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":225,"threads_started":1}
I20260809 06:55:45.944959 27409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:45.943920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:35861)
0809 06:55:45.944554 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:45.944639 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":240,"threads_started":1}
I20260809 06:55:45.969288 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:45.968535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:32853)
0809 06:55:45.969022 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:45.969109 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":269,"threads_started":1}
I20260809 06:55:46.472438 27411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:46.471653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:32809)
0809 06:55:46.472104 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:46.472187 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":231,"threads_started":1}
I20260809 06:55:46.946614 27412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:46.945923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:37597)
0809 06:55:46.946362 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:46.946449 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":243,"threads_started":1}
I20260809 06:55:46.970988 27413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:46.970290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:39835)
0809 06:55:46.970712 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:46.970803 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":215,"threads_started":1}
I20260809 06:55:47.474298 27414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:47.473464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:55775)
0809 06:55:47.474012 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:47.474097 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":257,"threads_started":1}
I20260809 06:55:47.948240 27415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:47.947511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:38149)
0809 06:55:47.947960 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:47.948050 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":229,"threads_started":1}
I20260809 06:55:47.972774 27416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:47.972039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:37787)
0809 06:55:47.972512 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:47.972605 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":260,"threads_started":1}
I20260809 06:55:48.476102 27417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:48.475297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:46403)
0809 06:55:48.475829 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:48.475936 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":289,"threads_started":1}
I20260809 06:55:48.950125 27418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:48.949355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:54037)
0809 06:55:48.949884 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:48.949965 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":272,"threads_started":1}
I20260809 06:55:48.974466 27419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:48.973705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:50587)
0809 06:55:48.974184 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:48.974276 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":251,"threads_started":1}
I20260809 06:55:49.477846 27420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:49.477085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:40141)
0809 06:55:49.477550 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:49.477642 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":233,"threads_started":1}
I20260809 06:55:49.952010 27421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:49.951181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:47007)
0809 06:55:49.951695 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:49.951807 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":234,"threads_started":1}
I20260809 06:55:49.976380 27422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:49.975494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:42237)
0809 06:55:49.976011 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:49.976104 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":283,"threads_started":1}
I20260809 06:55:50.479470 27423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:50.478744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:45677)
0809 06:55:50.479182 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:50.479279 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":215,"threads_started":1}
I20260809 06:55:50.953708 27424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:50.952953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:56711)
0809 06:55:50.953432 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:50.953522 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":246,"threads_started":1}
I20260809 06:55:50.978292 27425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:50.977525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.65:36773)
0809 06:55:50.978004 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:50.978104 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":251,"threads_started":1}
I20260809 06:55:51.481626 27426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:51.480765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.66:47733)
0809 06:55:51.481289 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:51.481430 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":283,"threads_started":1}
I20260809 06:55:51.936442 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 26926
I20260809 06:55:51.955943 27428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:51.954983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34639 (local address 127.10.205.67:51089)
0809 06:55:51.955551 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:51.955653 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:34639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":320,"threads_started":1}
I20260809 06:55:51.956522 27427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:51.937655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50476 (local address 127.10.205.65:42363)
0809 06:55:51.938304 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:51.938318 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:51.938359 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:55:51.940127 (+ 1768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:51.940137 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:51.940650 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:51.941023 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:51.942651 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:51.943981 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:51.945419 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:51.946157 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:51.946377 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:51.949441 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:51.949449 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:51.949468 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:51.949510 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:51.952557 (+ 3047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:51.953347 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:51.953355 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:51.953362 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:51.953548 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:51.953974 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:51.954003 (+ 29us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:51.954006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:51.954779 (+ 773us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:51.955116 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:51.955603 (+ 487us) server_negotiation.cc:299] Negotiation successful
0809 06:55:51.956111 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":244,"threads_started":1}
I20260809 06:55:51.958071 27093 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:52.045274 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 26926
I20260809 06:55:52.067473 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 27101
I20260809 06:55:52.085458 27432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:52.068631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38774 (local address 127.10.205.66:36405)
0809 06:55:52.069143 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:52.069159 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:52.069200 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:55:52.070730 (+ 1530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:52.070740 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:52.071180 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:52.071472 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:52.073100 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:52.074304 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:52.075505 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:52.076197 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:52.076508 (+ 311us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:52.079080 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:52.079088 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:52.079105 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:52.079166 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:52.082351 (+ 3185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:52.082984 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:52.082991 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:52.082997 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:52.083190 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:52.083523 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:52.083526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:52.083528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:52.084047 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:52.084367 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:52.084691 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 06:55:52.085165 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":233,"threads_started":1}
I20260809 06:55:52.086933 27232 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:52.172703 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 27101
I20260809 06:55:52.194693 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 27240
I20260809 06:55:52.213322 27435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:52.195808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41274 (local address 127.10.205.67:34085)
0809 06:55:52.196474 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:52.196489 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:52.196535 (+ 46us) server_negotiation.cc:407] Connection header received
0809 06:55:52.198208 (+ 1673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:52.198218 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:52.198651 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:52.198956 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:52.200617 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:52.201846 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:52.203059 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:52.203755 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:52.203897 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:52.206838 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:52.206847 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:52.206862 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:52.206909 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:52.210067 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:52.210774 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:52.210781 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:52.210788 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:52.210962 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:52.211311 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:52.211315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:52.211317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:52.211888 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:52.212145 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:52.212519 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 06:55:52.212973 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":281,"threads_started":1}
I20260809 06:55:52.214781 27372 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:52.301546 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 27240
2026-08-09T06:55:52Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24951 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:55:52 dist-test-slave-0b58 krb5kdc[27439](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:55:52 dist-test-slave-0b58 krb5kdc[27439](info): set up 2 sockets
Aug 09 06:55:52 dist-test-slave-0b58 krb5kdc[27439](info): commencing operation
krb5kdc: starting...
W20260809 06:55:53.456597 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.002s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:55:53 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:55:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:55:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:55:53.772264 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44851
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:44851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:54.130695 27453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:54.131000 27453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:54.131275 27453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:54.138654 27453 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 06:55:54.138782 27453 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 06:55:54.138867 27453 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 06:55:54.138980 27453 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:55:54.139065 27453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:54.139204 27453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:54.139300 27453 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:55:54.139385 27453 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:55:54.149840 27453 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:44851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:54.151232 27453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:54.152662 27453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:54.165074 27458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:54.165040 27459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:54.164988 27462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:54.165987 27453 server_base.cc:1034] running on GCE node
I20260809 06:55:54.166771 27453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:54.168176 27453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:54.169417 27453 hybrid_clock.cc:648] HybridClock initialized: now 1786258554169340 us; error 48 us; skew 500 ppm
I20260809 06:55:54.169785 27453 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:54 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258554, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:54.173194 27453 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:55:54.174803 27453 webserver.cc:460] Webserver started at http://127.10.205.126:43081/ using document root <none> and password file <none>
I20260809 06:55:54.175555 27453 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:54.175699 27453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:54.176044 27453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:55:54.179288 27453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "033938dfcf7446b0ba0a0c7fc0d72c71"
format_stamp: "Formatted at 2026-08-09 06:55:54 on dist-test-slave-0b58"
server_key: "bd29a27c2e8759b7391c7349767c9561"
server_key_iv: "dd644f9fc991b7f0f98b2498ad11b29c"
server_key_version: "encryptionkey@0"
I20260809 06:55:54.180128 27453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "033938dfcf7446b0ba0a0c7fc0d72c71"
format_stamp: "Formatted at 2026-08-09 06:55:54 on dist-test-slave-0b58"
server_key: "bd29a27c2e8759b7391c7349767c9561"
server_key_iv: "dd644f9fc991b7f0f98b2498ad11b29c"
server_key_version: "encryptionkey@0"
I20260809 06:55:54.185842 27453 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 06:55:54.189777 27469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:54.191331 27453 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:55:54.191586 27453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "033938dfcf7446b0ba0a0c7fc0d72c71"
format_stamp: "Formatted at 2026-08-09 06:55:54 on dist-test-slave-0b58"
server_key: "bd29a27c2e8759b7391c7349767c9561"
server_key_iv: "dd644f9fc991b7f0f98b2498ad11b29c"
server_key_version: "encryptionkey@0"
I20260809 06:55:54.191877 27453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:54.221182 27453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:54.225934 27453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:54.226277 27453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:54.247551 27453 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:44851
I20260809 06:55:54.247573 27525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:44851 every 8 connection(s)
I20260809 06:55:54.249094 27453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:55:54.252997 27526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:54.253098 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 27453
I20260809 06:55:54.253309 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:55:54.254020 11061 external_mini_cluster.cc:1428] Setting key 9703885604ad739d133659635c56bf4b
I20260809 06:55:54.268071 27526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Bootstrap starting.
Aug 09 06:55:54 dist-test-slave-0b58 krb5kdc[27439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:54.271611 27526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:54.273080 27526 log.cc:824] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:54.276922 27526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: No bootstrap required, opened a new log
I20260809 06:55:54.280750 27529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:54.256167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40224 (local address 127.10.205.126:44851)
0809 06:55:54.257088 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:54.257105 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:54.257160 (+ 55us) server_negotiation.cc:407] Connection header received
0809 06:55:54.259994 (+ 2834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:54.260025 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:54.260591 (+ 566us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:54.261085 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:54.262512 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:54.264637 (+ 2125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:54.266191 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:54.267277 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:54.267473 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:54.272062 (+ 4589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:54.272074 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:54.272101 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:54.272164 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:54.275804 (+ 3640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:54.276786 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:54.276793 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:54.276800 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:54.277014 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:54.277519 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:54.277524 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:54.277528 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:54.278139 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:54.278461 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:54.279034 (+ 573us) server_negotiation.cc:299] Negotiation successful
0809 06:55:54.279565 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":361,"threads_started":1}
I20260809 06:55:54.285275 27526 raft_consensus.cc:348] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } }
I20260809 06:55:54.285662 27526 raft_consensus.cc:374] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:54.285785 27526 raft_consensus.cc:729] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033938dfcf7446b0ba0a0c7fc0d72c71, State: Initialized, Role: FOLLOWER
I20260809 06:55:54.286401 27526 consensus_queue.cc:260] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } }
I20260809 06:55:54.286662 27526 raft_consensus.cc:388] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:55:54.286808 27526 raft_consensus.cc:482] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:55:54.286988 27526 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:54.289500 27526 raft_consensus.cc:504] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } }
I20260809 06:55:54.290071 27526 leader_election.cc:302] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 033938dfcf7446b0ba0a0c7fc0d72c71; no voters:
I20260809 06:55:54.290758 27526 leader_election.cc:288] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:55:54.290932 27531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:55:54.292570 27531 raft_consensus.cc:686] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 1 LEADER]: Becoming Leader. State: Replica: 033938dfcf7446b0ba0a0c7fc0d72c71, State: Running, Role: LEADER
I20260809 06:55:54.293089 27526 sys_catalog.cc:564] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:55:54.293092 27531 consensus_queue.cc:237] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } }
I20260809 06:55:54.296039 27533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 033938dfcf7446b0ba0a0c7fc0d72c71. Latest consensus state: current_term: 1 leader_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } } }
I20260809 06:55:54.296464 27533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:54.296164 27532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } } }
I20260809 06:55:54.296897 27532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: This master's current role is: LEADER
I20260809 06:55:54.304298 27540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:55:54.309758 27540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:55:54.318958 27540 catalog_manager.cc:1347] Generated new cluster ID: 8d6e100e8d5b4d71aa19edbf796ceb79
I20260809 06:55:54.319092 27540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:55:54.343078 27540 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:55:54.344812 27540 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:55:54.354897 27540 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Generated new TSK 0
I20260809 06:55:54.355819 27540 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:55:54.436574 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44851
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:54.794549 27552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:54.794857 27552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:54.794955 27552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:54.802677 27552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:54.802815 27552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:54.802987 27552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:55:54.813813 27552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:54.815254 27552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:54.816609 27552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:54.830529 27557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:54.830466 27558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:54.830534 27560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:54.831674 27552 server_base.cc:1034] running on GCE node
I20260809 06:55:54.832434 27552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:54.833458 27552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:54.834713 27552 hybrid_clock.cc:648] HybridClock initialized: now 1786258554834659 us; error 38 us; skew 500 ppm
I20260809 06:55:54.835048 27552 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:54 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258554, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:54.838503 27552 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:55:54.840063 27552 webserver.cc:460] Webserver started at http://127.10.205.65:42633/ using document root <none> and password file <none>
I20260809 06:55:54.840847 27552 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:54.840999 27552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:54.841351 27552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:55:54.844535 27552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "038fa2d8f0394773bf60b6cd43fe4513"
format_stamp: "Formatted at 2026-08-09 06:55:54 on dist-test-slave-0b58"
server_key: "261a32b206f99e3d97f7441bc7674b3b"
server_key_iv: "a810e925a12fe721c4bc08aa406dd07c"
server_key_version: "encryptionkey@0"
I20260809 06:55:54.845422 27552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "038fa2d8f0394773bf60b6cd43fe4513"
format_stamp: "Formatted at 2026-08-09 06:55:54 on dist-test-slave-0b58"
server_key: "261a32b206f99e3d97f7441bc7674b3b"
server_key_iv: "a810e925a12fe721c4bc08aa406dd07c"
server_key_version: "encryptionkey@0"
I20260809 06:55:54.851292 27552 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:55:54.855301 27567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:54.856840 27552 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 06:55:54.857059 27552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "038fa2d8f0394773bf60b6cd43fe4513"
format_stamp: "Formatted at 2026-08-09 06:55:54 on dist-test-slave-0b58"
server_key: "261a32b206f99e3d97f7441bc7674b3b"
server_key_iv: "a810e925a12fe721c4bc08aa406dd07c"
server_key_version: "encryptionkey@0"
I20260809 06:55:54.857352 27552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:54.876484 27552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:54.880802 27552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:54.881121 27552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:54.883044 27552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:54.884703 27552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:54.884786 27552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:54.884946 27552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:54.885011 27552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:54.921741 27552 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:33437
I20260809 06:55:54.921787 27690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:33437 every 8 connection(s)
I20260809 06:55:54.923136 27552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:55:54.928249 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 27552
I20260809 06:55:54.928553 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:55:54.929433 11061 external_mini_cluster.cc:1428] Setting key 0c3018982cd3b417bddd6e31ed4d6111
Aug 09 06:55:54 dist-test-slave-0b58 krb5kdc[27439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258554, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:54.947520 27694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:54.925845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:59429 (local address 127.10.205.126:44851)
0809 06:55:54.926365 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:54.926373 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:54.927432 (+ 1059us) server_negotiation.cc:407] Connection header received
0809 06:55:54.930497 (+ 3065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:54.930504 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:54.930617 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:54.930760 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:54.932724 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:54.933467 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:54.936065 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:54.936553 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:54.936653 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:54.941355 (+ 4702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:54.941359 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:54.941362 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:54.941399 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:54.944161 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:54.945078 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:54.945082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:54.945085 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:54.945212 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:54.945666 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:54.945669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:54.945671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:54.945943 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:54.946135 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:54.946890 (+ 755us) server_negotiation.cc:299] Negotiation successful
0809 06:55:54.947130 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":242,"threads_started":1}
I20260809 06:55:54.948629 27695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:54.926483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:59429)
0809 06:55:54.927251 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:54.927302 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:54.930108 (+ 2806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:54.931046 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:54.931055 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:54.931604 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:54.932525 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:54.932557 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:54.933657 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:54.933665 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:54.935906 (+ 2241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:54.935925 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:54.936803 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:54.936813 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:54.937149 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:54.937952 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:54.937994 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:54.941119 (+ 3125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:54.944351 (+ 3232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:54.944363 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:54.944385 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:54.944914 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:54.945334 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:54.945339 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:54.945344 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:54.945533 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:54.946075 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:54.946102 (+ 27us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:54.946499 (+ 397us) client_negotiation.cc:769] Sending connection context
0809 06:55:54.946779 (+ 280us) client_negotiation.cc:240] Negotiation successful
0809 06:55:54.947364 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":298,"threads_started":1}
I20260809 06:55:54.950305 27691 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44851
I20260809 06:55:54.950655 27691 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:54.951668 27691 heartbeater.cc:511] Master 127.10.205.126:44851 requested a full tablet report, sending...
I20260809 06:55:54.954097 27486 ts_manager.cc:194] Registered new tserver with Master: 038fa2d8f0394773bf60b6cd43fe4513 (127.10.205.65:33437)
I20260809 06:55:54.955612 27486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:59429
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:55:54.999812 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44851
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:55.357875 27698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:55.358196 27698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:55.358294 27698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:55.366073 27698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:55.366230 27698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:55.366349 27698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:55:55.376611 27698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:55.378103 27698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:55.379465 27698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:55.394001 27704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:55.394372 27706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:55.394086 27703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:55.395383 27698 server_base.cc:1034] running on GCE node
I20260809 06:55:55.396065 27698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:55.397174 27698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:55.398401 27698 hybrid_clock.cc:648] HybridClock initialized: now 1786258555398340 us; error 56 us; skew 500 ppm
I20260809 06:55:55.398734 27698 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:55 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258555, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:55.402037 27698 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:55:55.403721 27698 webserver.cc:460] Webserver started at http://127.10.205.66:34387/ using document root <none> and password file <none>
I20260809 06:55:55.404553 27698 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:55.404706 27698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:55.405055 27698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:55:55.408211 27698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a"
format_stamp: "Formatted at 2026-08-09 06:55:55 on dist-test-slave-0b58"
server_key: "f6cf17e53a9d02bea71de779199b06e3"
server_key_iv: "659121efa3e2a1caa3f2f007baf383e0"
server_key_version: "encryptionkey@0"
I20260809 06:55:55.409094 27698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a"
format_stamp: "Formatted at 2026-08-09 06:55:55 on dist-test-slave-0b58"
server_key: "f6cf17e53a9d02bea71de779199b06e3"
server_key_iv: "659121efa3e2a1caa3f2f007baf383e0"
server_key_version: "encryptionkey@0"
I20260809 06:55:55.414499 27698 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:55:55.418203 27714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:55.419610 27698 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:55:55.419818 27698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a"
format_stamp: "Formatted at 2026-08-09 06:55:55 on dist-test-slave-0b58"
server_key: "f6cf17e53a9d02bea71de779199b06e3"
server_key_iv: "659121efa3e2a1caa3f2f007baf383e0"
server_key_version: "encryptionkey@0"
I20260809 06:55:55.420037 27698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:55.433434 27698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:55.437822 27698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:55.438143 27698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:55.439173 27698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:55.440644 27698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:55.440773 27698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:55.440912 27698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:55.440984 27698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:55.476661 27698 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:37125
I20260809 06:55:55.476725 27833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:37125 every 8 connection(s)
I20260809 06:55:55.478060 27698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:55:55.481170 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 27698
I20260809 06:55:55.481410 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:55:55.482115 11061 external_mini_cluster.cc:1428] Setting key dce53dcf10b728948d37cd5333b12cc9
Aug 09 06:55:55 dist-test-slave-0b58 krb5kdc[27439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258555, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:55.500236 27836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:55.480737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:40179 (local address 127.10.205.126:44851)
0809 06:55:55.481232 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:55.481237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:55.482454 (+ 1217us) server_negotiation.cc:407] Connection header received
0809 06:55:55.484757 (+ 2303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:55.484763 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:55.484867 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:55.484987 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:55.486612 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:55.487392 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:55.489164 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:55.489613 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:55.489753 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:55.493425 (+ 3672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:55.493431 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:55.493434 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:55.493471 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:55.496705 (+ 3234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:55.497823 (+ 1118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:55.497828 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:55.497830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:55.497965 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:55.498489 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:55.498492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:55.498494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:55.498756 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:55.498881 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:55.499772 (+ 891us) server_negotiation.cc:299] Negotiation successful
0809 06:55:55.499946 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":267,"threads_started":1}
I20260809 06:55:55.501966 27837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:55.481367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:40179)
0809 06:55:55.482223 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:55.482317 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:55.484466 (+ 2149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:55.485250 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:55.485259 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:55.485816 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:55.486427 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:55.486445 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:55.487566 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:55.487570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:55.488995 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:55.489014 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:55.489877 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:55.489884 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:55.490118 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:55.490843 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:55.490866 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:55.493114 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:55.496856 (+ 3742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:55.496866 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:55.496905 (+ 39us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:55.497667 (+ 762us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:55.498090 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:55.498097 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:55.498104 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:55.498371 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:55.498894 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:55.498905 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:55.499376 (+ 471us) client_negotiation.cc:769] Sending connection context
0809 06:55:55.499691 (+ 315us) client_negotiation.cc:240] Negotiation successful
0809 06:55:55.500388 (+ 697us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":352,"threads_started":1}
I20260809 06:55:55.503614 27834 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44851
I20260809 06:55:55.503961 27834 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:55.504879 27834 heartbeater.cc:511] Master 127.10.205.126:44851 requested a full tablet report, sending...
I20260809 06:55:55.506523 27486 ts_manager.cc:194] Registered new tserver with Master: 38d3d0ac1bb04f03ac6b1ee9af035e2a (127.10.205.66:37125)
I20260809 06:55:55.507436 27486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:40179
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:55:55.553650 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44851
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:55:55.902413 27840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:55:55.902724 27840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:55:55.902936 27840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:55:55.912210 27840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:55:55.912467 27840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:55:55.912691 27840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:55:55.923513 27840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:55:55.925053 27840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:55:55.926412 27840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:55:55.940172 27845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:55.940143 27848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:55:55.940115 27846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:55:55.940968 27840 server_base.cc:1034] running on GCE node
I20260809 06:55:55.941618 27840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:55:55.942540 27840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:55:55.943781 27840 hybrid_clock.cc:648] HybridClock initialized: now 1786258555943741 us; error 72 us; skew 500 ppm
I20260809 06:55:55.944108 27840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:55:55 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258555, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:55:55.947501 27840 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:55:55.949079 27840 webserver.cc:460] Webserver started at http://127.10.205.67:41357/ using document root <none> and password file <none>
I20260809 06:55:55.949766 27840 fs_manager.cc:359] Metadata directory not provided
I20260809 06:55:55.949873 27840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:55:55.950138 27840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:55:55.953317 27840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "b4232a90fa32411487bed9581875cc21"
format_stamp: "Formatted at 2026-08-09 06:55:55 on dist-test-slave-0b58"
server_key: "fe45753ea85946235e144a1a826ffa48"
server_key_iv: "67feeaf5e43f641c66ec86d2a2c3c9b3"
server_key_version: "encryptionkey@0"
I20260809 06:55:55.954087 27840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "b4232a90fa32411487bed9581875cc21"
format_stamp: "Formatted at 2026-08-09 06:55:55 on dist-test-slave-0b58"
server_key: "fe45753ea85946235e144a1a826ffa48"
server_key_iv: "67feeaf5e43f641c66ec86d2a2c3c9b3"
server_key_version: "encryptionkey@0"
I20260809 06:55:55.959630 27840 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:55:55.959895 27691 heartbeater.cc:503] Master 127.10.205.126:44851 was elected leader, sending a full tablet report...
I20260809 06:55:55.963820 27855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:55.965245 27840 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 06:55:55.965391 27840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "b4232a90fa32411487bed9581875cc21"
format_stamp: "Formatted at 2026-08-09 06:55:55 on dist-test-slave-0b58"
server_key: "fe45753ea85946235e144a1a826ffa48"
server_key_iv: "67feeaf5e43f641c66ec86d2a2c3c9b3"
server_key_version: "encryptionkey@0"
I20260809 06:55:55.965570 27840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:55:55.988859 27840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:55:55.993583 27840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:55:55.993903 27840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:55:55.995048 27840 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:55:55.996694 27840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:55:55.996779 27840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:55.996866 27840 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:55:55.996910 27840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:55:56.031880 27840 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:37453
I20260809 06:55:56.031932 27975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:37453 every 8 connection(s)
I20260809 06:55:56.033336 27840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:55:56.034969 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 27840
I20260809 06:55:56.035172 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:55:56.035719 11061 external_mini_cluster.cc:1428] Setting key d46f5f1482736c09743e6030a845d062
Aug 09 06:55:56 dist-test-slave-0b58 krb5kdc[27439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258555, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:55:56.055332 27978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.036314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:39585 (local address 127.10.205.126:44851)
0809 06:55:56.036835 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:56.036863 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:56.037965 (+ 1102us) server_negotiation.cc:407] Connection header received
0809 06:55:56.040317 (+ 2352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:56.040327 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:56.040416 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:56.040512 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:56.042010 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.042819 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.044382 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.044787 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.044882 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.048412 (+ 3530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:56.048417 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:56.048420 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:56.048458 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:56.052416 (+ 3958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:56.053208 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:56.053212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:56.053214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:56.053354 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:56.053751 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:56.053755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:56.053757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:56.054033 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:56.054156 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:56.054845 (+ 689us) server_negotiation.cc:299] Negotiation successful
0809 06:55:56.055023 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":269,"threads_started":1}
I20260809 06:55:56.056427 27979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.036929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:39585)
0809 06:55:56.037742 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:56.037821 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:56.039994 (+ 2173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:56.040723 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:56.040731 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:56.041241 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:55:56.041857 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:56.041875 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.042961 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.042964 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:56.044207 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:56.044219 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.044989 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.044993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:56.045220 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.045887 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:55:56.045910 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:55:56.048108 (+ 2198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:55:56.052566 (+ 4458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:56.052573 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:56.052591 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:56.053099 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:56.053451 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:55:56.053454 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:55:56.053456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:55:56.053653 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:55:56.054142 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:55:56.054148 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:55:56.054516 (+ 368us) client_negotiation.cc:769] Sending connection context
0809 06:55:56.054763 (+ 247us) client_negotiation.cc:240] Negotiation successful
0809 06:55:56.055195 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":391,"threads_started":1}
I20260809 06:55:56.058002 27976 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44851
I20260809 06:55:56.058346 27976 heartbeater.cc:464] Registering TS with master...
I20260809 06:55:56.059101 27976 heartbeater.cc:511] Master 127.10.205.126:44851 requested a full tablet report, sending...
I20260809 06:55:56.060724 27486 ts_manager.cc:194] Registered new tserver with Master: b4232a90fa32411487bed9581875cc21 (127.10.205.67:37453)
I20260809 06:55:56.061618 27486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:39585
I20260809 06:55:56.064517 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:55:56.082065 27978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.069151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40240 (local address 127.10.205.126:44851)
0809 06:55:56.069340 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:56.069345 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:56.069889 (+ 544us) server_negotiation.cc:407] Connection header received
0809 06:55:56.070120 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:56.070124 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:56.070203 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:56.070337 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:56.071817 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.072584 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.073851 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.074258 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.074357 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.077002 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:56.077007 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:56.077010 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:56.077040 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:56.079456 (+ 2416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:56.080120 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:56.080124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:56.080126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:56.080250 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:56.080611 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:56.080614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:56.080616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:56.080920 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:56.081094 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:56.081445 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 06:55:56.081836 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:55:56.086413 27486 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40240:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:55:56.093418 27486 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:55:56.120885 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.106383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58522 (local address 127.10.205.65:33437)
0809 06:55:56.107220 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:56.107230 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:56.110647 (+ 3417us) server_negotiation.cc:407] Connection header received
0809 06:55:56.111042 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:56.111055 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:56.111409 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:56.111618 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:56.112929 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.115113 (+ 2184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.118190 (+ 3077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.119674 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.119835 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.120091 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:56.120380 (+ 289us) server_negotiation.cc:299] Negotiation successful
0809 06:55:56.120547 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":386,"threads_started":1}
I20260809 06:55:56.120972 27993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.105820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33437 (local address 127.0.0.1:58522)
0809 06:55:56.110485 (+ 4665us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:56.110510 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:56.110783 (+ 273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:56.112016 (+ 1233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:56.112028 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:56.112070 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:56.112645 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:56.112663 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.115378 (+ 2715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.115387 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:56.117916 (+ 2529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:56.117929 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.119891 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.119897 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:56.120094 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.120164 (+ 70us) client_negotiation.cc:769] Sending connection context
0809 06:55:56.120324 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 06:55:56.120535 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4497,"thread_start_us":10741,"threads_started":1}
I20260809 06:55:56.125468 27989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.105728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37453 (local address 127.0.0.1:40644)
0809 06:55:56.109109 (+ 3381us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:56.109189 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:56.109420 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:56.117810 (+ 8390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:56.117820 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:56.117853 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:56.118293 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:56.118302 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.120395 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.120400 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:56.122706 (+ 2306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:56.122722 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.124642 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.124650 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:56.124839 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.124871 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:55:56.124984 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 06:55:56.125115 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3050,"thread_start_us":2859,"threads_started":1}
I20260809 06:55:56.125620 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.105975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40644 (local address 127.10.205.67:37453)
0809 06:55:56.117179 (+ 11204us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:56.117187 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:56.117217 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:55:56.117308 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:56.117313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:56.117559 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:56.117784 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:56.118493 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.120208 (+ 1715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.122913 (+ 2705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.124371 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.124508 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.124736 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:56.125047 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 06:55:56.125249 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11011,"thread_start_us":10834,"threads_started":1}
I20260809 06:55:56.125129 27622 tablet_service.cc:1467] Processing CreateTablet for tablet 1da7d3aea350494ea2cacf6236e98fc0 (DEFAULT_TABLE table=test-table [id=cc4f1cc5d9634983b9222373a60209bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:55:56.126704 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.109776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:37125 (local address 127.0.0.1:51164)
0809 06:55:56.116884 (+ 7108us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:56.116904 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:56.117046 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:56.118495 (+ 1449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:56.118499 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:56.118526 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:56.118998 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:56.119014 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.121324 (+ 2310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.121330 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:56.123396 (+ 2066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:56.123410 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.125367 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.125375 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:56.125952 (+ 577us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.126048 (+ 96us) client_negotiation.cc:769] Sending connection context
0809 06:55:56.126139 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 06:55:56.126279 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6952,"mutex_wait_us":1,"thread_start_us":308,"threads_started":1}
I20260809 06:55:56.126986 27622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1da7d3aea350494ea2cacf6236e98fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:56.128078 27994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.109821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51164 (local address 127.10.205.66:37125)
0809 06:55:56.116455 (+ 6634us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:56.116466 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:56.117187 (+ 721us) server_negotiation.cc:407] Connection header received
0809 06:55:56.117298 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:56.117306 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:56.117559 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:56.117794 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:56.119210 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.120805 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.123580 (+ 2775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.125121 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.127262 (+ 2141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.127463 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:56.127537 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 06:55:56.127738 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6440,"thread_start_us":6310,"threads_started":1}
I20260809 06:55:56.129513 27909 tablet_service.cc:1467] Processing CreateTablet for tablet 1da7d3aea350494ea2cacf6236e98fc0 (DEFAULT_TABLE table=test-table [id=cc4f1cc5d9634983b9222373a60209bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:55:56.130955 27909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1da7d3aea350494ea2cacf6236e98fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:56.131546 27764 tablet_service.cc:1467] Processing CreateTablet for tablet 1da7d3aea350494ea2cacf6236e98fc0 (DEFAULT_TABLE table=test-table [id=cc4f1cc5d9634983b9222373a60209bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:55:56.132984 27764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1da7d3aea350494ea2cacf6236e98fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:55:56.143613 27995 tablet_bootstrap.cc:492] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513: Bootstrap starting.
I20260809 06:55:56.147887 27997 tablet_bootstrap.cc:492] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Bootstrap starting.
I20260809 06:55:56.148708 27996 tablet_bootstrap.cc:492] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21: Bootstrap starting.
I20260809 06:55:56.149122 27995 tablet_bootstrap.cc:654] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:56.150689 27995 log.cc:824] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:56.151433 27997 tablet_bootstrap.cc:654] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:56.152360 27996 tablet_bootstrap.cc:654] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21: Neither blocks nor log segments found. Creating new log.
I20260809 06:55:56.152776 27997 log.cc:824] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:56.153550 27996 log.cc:824] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21: Log is configured to *not* fsync() on all Append() calls
I20260809 06:55:56.154438 27995 tablet_bootstrap.cc:492] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513: No bootstrap required, opened a new log
I20260809 06:55:56.154747 27995 ts_tablet_manager.cc:1397] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20260809 06:55:56.155932 27997 tablet_bootstrap.cc:492] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: No bootstrap required, opened a new log
I20260809 06:55:56.156210 27997 ts_tablet_manager.cc:1397] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260809 06:55:56.156980 27996 tablet_bootstrap.cc:492] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21: No bootstrap required, opened a new log
I20260809 06:55:56.157243 27996 ts_tablet_manager.cc:1397] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 06:55:56.165315 27996 raft_consensus.cc:348] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } }
I20260809 06:55:56.165766 27996 raft_consensus.cc:374] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:56.165863 27996 raft_consensus.cc:729] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4232a90fa32411487bed9581875cc21, State: Initialized, Role: FOLLOWER
I20260809 06:55:56.166040 27995 raft_consensus.cc:348] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } }
I20260809 06:55:56.166594 27995 raft_consensus.cc:374] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:56.166713 27995 raft_consensus.cc:729] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038fa2d8f0394773bf60b6cd43fe4513, State: Initialized, Role: FOLLOWER
I20260809 06:55:56.166595 27996 consensus_queue.cc:260] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } }
I20260809 06:55:56.167325 27995 consensus_queue.cc:260] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } }
I20260809 06:55:56.167198 27997 raft_consensus.cc:348] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } }
I20260809 06:55:56.167666 27997 raft_consensus.cc:374] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:55:56.167783 27997 raft_consensus.cc:729] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38d3d0ac1bb04f03ac6b1ee9af035e2a, State: Initialized, Role: FOLLOWER
I20260809 06:55:56.168051 27976 heartbeater.cc:503] Master 127.10.205.126:44851 was elected leader, sending a full tablet report...
I20260809 06:55:56.168709 27996 ts_tablet_manager.cc:1428] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260809 06:55:56.168668 27997 consensus_queue.cc:260] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } }
I20260809 06:55:56.170713 27995 ts_tablet_manager.cc:1428] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513: Time spent starting tablet: real 0.016s user 0.011s sys 0.007s
I20260809 06:55:56.173122 27834 heartbeater.cc:503] Master 127.10.205.126:44851 was elected leader, sending a full tablet report...
I20260809 06:55:56.173712 27997 ts_tablet_manager.cc:1428] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Time spent starting tablet: real 0.017s user 0.010s sys 0.005s
W20260809 06:55:56.175958 27692 tablet.cc:2369] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:55:56.230396 27835 tablet.cc:2369] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:55:56.285176 27977 tablet.cc:2369] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:55:56.303486 28003 raft_consensus.cc:482] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:55:56.303876 28003 raft_consensus.cc:504] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } }
I20260809 06:55:56.305863 28003 leader_election.cc:288] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4232a90fa32411487bed9581875cc21 (127.10.205.67:37453), 038fa2d8f0394773bf60b6cd43fe4513 (127.10.205.65:33437)
I20260809 06:55:56.312911 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.306295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:52741 (local address 127.10.205.67:37453)
0809 06:55:56.306522 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:56.306529 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:56.307093 (+ 564us) server_negotiation.cc:407] Connection header received
0809 06:55:56.307321 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:56.307328 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:56.307411 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:56.307505 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:56.308197 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.309030 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.310981 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.311857 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.312053 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.312133 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:56.312477 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 06:55:56.312618 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:55:56.313005 28004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.306093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37453 (local address 127.10.205.66:52741)
0809 06:55:56.306950 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:56.306978 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:56.307161 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:56.307543 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:56.307548 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:56.307576 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:56.308043 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:56.308055 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.309201 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.309209 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:56.310799 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:56.310811 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.312083 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.312090 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:56.312279 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.312318 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 06:55:56.312426 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 06:55:56.312562 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"mutex_wait_us":27,"thread_start_us":431,"threads_started":1}
I20260809 06:55:56.313258 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.306538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:56619 (local address 127.10.205.65:33437)
0809 06:55:56.306738 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:56.306745 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:56.307366 (+ 621us) server_negotiation.cc:407] Connection header received
0809 06:55:56.307543 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:56.307549 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:56.307630 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:56.307733 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:55:56.308404 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.309147 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.310952 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.311952 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.312106 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.312175 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:56.312823 (+ 648us) server_negotiation.cc:299] Negotiation successful
0809 06:55:56.312961 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:55:56.313926 28005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.306453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33437 (local address 127.10.205.66:56619)
0809 06:55:56.307244 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0809 06:55:56.307262 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:55:56.307386 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:55:56.307760 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:55:56.307767 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:55:56.307793 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:55:56.308188 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:56.308198 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.309313 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.309319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:56.310784 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:55:56.310797 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.312385 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.312409 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:55:56.312601 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.312633 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:55:56.313350 (+ 717us) client_negotiation.cc:240] Negotiation successful
0809 06:55:56.313487 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"mutex_wait_us":5,"thread_start_us":418,"threads_started":1}
I20260809 06:55:56.314158 27930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1da7d3aea350494ea2cacf6236e98fc0" candidate_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4232a90fa32411487bed9581875cc21" is_pre_election: true
I20260809 06:55:56.314802 27930 raft_consensus.cc:2454] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38d3d0ac1bb04f03ac6b1ee9af035e2a in term 0.
I20260809 06:55:56.315034 27642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1da7d3aea350494ea2cacf6236e98fc0" candidate_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038fa2d8f0394773bf60b6cd43fe4513" is_pre_election: true
I20260809 06:55:56.315524 27718 leader_election.cc:302] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38d3d0ac1bb04f03ac6b1ee9af035e2a, b4232a90fa32411487bed9581875cc21; no voters:
I20260809 06:55:56.315621 27642 raft_consensus.cc:2454] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38d3d0ac1bb04f03ac6b1ee9af035e2a in term 0.
I20260809 06:55:56.315908 28003 raft_consensus.cc:2781] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:55:56.316051 28003 raft_consensus.cc:482] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:55:56.316181 28003 raft_consensus.cc:3037] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:56.318475 28003 raft_consensus.cc:504] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } }
I20260809 06:55:56.319166 28003 leader_election.cc:288] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [CANDIDATE]: Term 1 election: Requested vote from peers b4232a90fa32411487bed9581875cc21 (127.10.205.67:37453), 038fa2d8f0394773bf60b6cd43fe4513 (127.10.205.65:33437)
I20260809 06:55:56.319623 27930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1da7d3aea350494ea2cacf6236e98fc0" candidate_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4232a90fa32411487bed9581875cc21"
I20260809 06:55:56.319722 27642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1da7d3aea350494ea2cacf6236e98fc0" candidate_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038fa2d8f0394773bf60b6cd43fe4513"
I20260809 06:55:56.319834 27930 raft_consensus.cc:3037] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:56.319972 27642 raft_consensus.cc:3037] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:55:56.322122 27930 raft_consensus.cc:2454] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38d3d0ac1bb04f03ac6b1ee9af035e2a in term 1.
I20260809 06:55:56.322216 27642 raft_consensus.cc:2454] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38d3d0ac1bb04f03ac6b1ee9af035e2a in term 1.
I20260809 06:55:56.322557 27718 leader_election.cc:302] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38d3d0ac1bb04f03ac6b1ee9af035e2a, b4232a90fa32411487bed9581875cc21; no voters:
I20260809 06:55:56.322865 28003 raft_consensus.cc:2781] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:55:56.323329 28003 raft_consensus.cc:686] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 1 LEADER]: Becoming Leader. State: Replica: 38d3d0ac1bb04f03ac6b1ee9af035e2a, State: Running, Role: LEADER
I20260809 06:55:56.323899 28003 consensus_queue.cc:237] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } }
I20260809 06:55:56.328629 27485 catalog_manager.cc:5495] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 38d3d0ac1bb04f03ac6b1ee9af035e2a (127.10.205.66). New cstate: current_term: 1 leader_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } health_report { overall_health: HEALTHY } } }
I20260809 06:55:56.371647 27994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.366029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51172 (local address 127.10.205.66:37125)
0809 06:55:56.366254 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:56.366260 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:56.366279 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:55:56.366461 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:56.366465 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:56.366544 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:56.366708 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:55:56.367153 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.367922 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.369476 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.369897 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.370056 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.370559 (+ 503us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:55:56.371052 (+ 493us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:55:56.371219 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:56.371275 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 06:55:56.371367 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 06:55:56.379678 27642 raft_consensus.cc:1261] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513 [term 1 FOLLOWER]: Refusing update from remote peer 38d3d0ac1bb04f03ac6b1ee9af035e2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:55:56.379702 27930 raft_consensus.cc:1261] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21 [term 1 FOLLOWER]: Refusing update from remote peer 38d3d0ac1bb04f03ac6b1ee9af035e2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:55:56.380683 28003 consensus_queue.cc:1035] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:55:56.380965 28006 consensus_queue.cc:1035] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:55:56.394660 28009 mvcc.cc:205] Tried to move back new op lower bound from 7316515046921007104 to 7316515046706896896. Current Snapshot: MvccSnapshot[applied={T|T < 7316515046921007104}]
I20260809 06:55:56.408427 27484 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:55:56.408792 27484 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:55:56.412678 27484 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Sending DeleteTablet for 3 replicas of tablet 1da7d3aea350494ea2cacf6236e98fc0
I20260809 06:55:56.414049 27622 tablet_service.cc:1514] Processing DeleteTablet for tablet 1da7d3aea350494ea2cacf6236e98fc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:55:56 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:58522
I20260809 06:55:56.414217 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 27552
I20260809 06:55:56.414448 27909 tablet_service.cc:1514] Processing DeleteTablet for tablet 1da7d3aea350494ea2cacf6236e98fc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:55:56 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:40644
I20260809 06:55:56.415156 27764 tablet_service.cc:1514] Processing DeleteTablet for tablet 1da7d3aea350494ea2cacf6236e98fc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:55:56 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:51164
I20260809 06:55:56.425441 28019 tablet_replica.cc:330] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21: stopping tablet replica
I20260809 06:55:56.426079 28019 raft_consensus.cc:2229] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:55:56.426806 28019 raft_consensus.cc:2258] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:55:56.428964 28021 tablet_replica.cc:330] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: stopping tablet replica
I20260809 06:55:56.429263 28018 tablet_replica.cc:330] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513: stopping tablet replica
I20260809 06:55:56.429729 28018 raft_consensus.cc:2229] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:55:56.429929 28021 raft_consensus.cc:2229] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:55:56.430401 28018 raft_consensus.cc:2258] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:55:56.430653 28021 raft_consensus.cc:2258] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:55:56.432924 28018 ts_tablet_manager.cc:1905] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:55:56.434005 28021 ts_tablet_manager.cc:1905] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:55:56.439960 28019 ts_tablet_manager.cc:1905] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:55:56.440327 28018 ts_tablet_manager.cc:1918] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:55:56.440546 28018 log.cc:1196] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/1da7d3aea350494ea2cacf6236e98fc0
Aug 09 06:55:56 dist-test-slave-0b58 krb5kdc[27439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:55:56.441233 28018 ts_tablet_manager.cc:1939] T 1da7d3aea350494ea2cacf6236e98fc0 P 038fa2d8f0394773bf60b6cd43fe4513: Deleting consensus metadata
I20260809 06:55:56.443325 27471 catalog_manager.cc:4841] TS 038fa2d8f0394773bf60b6cd43fe4513 (127.10.205.65:33437): tablet 1da7d3aea350494ea2cacf6236e98fc0 (table test-table [id=cc4f1cc5d9634983b9222373a60209bb]) successfully deleted
I20260809 06:55:56.446241 28019 ts_tablet_manager.cc:1918] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:55:56.446426 28019 log.cc:1196] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/1da7d3aea350494ea2cacf6236e98fc0
I20260809 06:55:56.447023 28019 ts_tablet_manager.cc:1939] T 1da7d3aea350494ea2cacf6236e98fc0 P b4232a90fa32411487bed9581875cc21: Deleting consensus metadata
I20260809 06:55:56.449047 27473 catalog_manager.cc:4841] TS b4232a90fa32411487bed9581875cc21 (127.10.205.67:37453): tablet 1da7d3aea350494ea2cacf6236e98fc0 (table test-table [id=cc4f1cc5d9634983b9222373a60209bb]) successfully deleted
I20260809 06:55:56.449265 28021 ts_tablet_manager.cc:1918] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:55:56.449469 28021 log.cc:1196] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/1da7d3aea350494ea2cacf6236e98fc0
I20260809 06:55:56.450026 28021 ts_tablet_manager.cc:1939] T 1da7d3aea350494ea2cacf6236e98fc0 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Deleting consensus metadata
I20260809 06:55:56.450608 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.415446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58536 (local address 127.10.205.65:33437)
0809 06:55:56.415642 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:56.415650 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:56.428331 (+ 12681us) server_negotiation.cc:407] Connection header received
0809 06:55:56.429468 (+ 1137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:56.429473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:56.429558 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:56.429667 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:56.432135 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.433333 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.435446 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.436112 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.436213 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.442519 (+ 6306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:56.442536 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:56.442554 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:56.442605 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:56.446612 (+ 4007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:56.447621 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:56.447630 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:56.447633 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:56.447803 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:56.448384 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:56.448389 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:56.448393 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:56.448895 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:56.449166 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:56.449953 (+ 787us) server_negotiation.cc:299] Negotiation successful
0809 06:55:56.450234 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:55:56.451282 27686 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:56.451707 27473 catalog_manager.cc:4841] TS 38d3d0ac1bb04f03ac6b1ee9af035e2a (127.10.205.66:37125): tablet 1da7d3aea350494ea2cacf6236e98fc0 (table test-table [id=cc4f1cc5d9634983b9222373a60209bb]) successfully deleted
I20260809 06:55:56.561811 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 27552
I20260809 06:55:56.584003 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 27698
Aug 09 06:55:56 dist-test-slave-0b58 krb5kdc[27439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:55:56.606262 27994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.584904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51180 (local address 127.10.205.66:37125)
0809 06:55:56.585106 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:56.585112 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:56.585134 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:55:56.585324 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:56.585330 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:56.585422 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:56.585540 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:56.587027 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.588393 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.590048 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.590724 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.590846 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.598883 (+ 8037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:56.598897 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:56.598917 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:56.598967 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:56.603098 (+ 4131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:56.603938 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:56.603949 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:56.603955 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:56.604134 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:56.604584 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:56.604589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:56.604592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:56.605081 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:56.605453 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:56.605603 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 06:55:56.605834 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 06:55:56.607070 27829 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:56.725229 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 27698
I20260809 06:55:56.747648 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 27840
Aug 09 06:55:56 dist-test-slave-0b58 krb5kdc[27439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:55:56.763568 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:55:56.748577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40650 (local address 127.10.205.67:37453)
0809 06:55:56.748780 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 06:55:56.748798 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 06:55:56.748819 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:55:56.748888 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:55:56.748891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:55:56.748952 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:55:56.749073 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:55:56.750426 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.751169 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.752568 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:55:56.752975 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:55:56.753114 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:55:56.757757 (+ 4643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:55:56.757773 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:55:56.757796 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:55:56.757833 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:55:56.760621 (+ 2788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:56.761356 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:56.761364 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:56.761366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:56.761510 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:55:56.761972 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:55:56.761976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:55:56.761978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:55:56.762326 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:55:56.762636 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0809 06:55:56.762984 (+ 348us) server_negotiation.cc:299] Negotiation successful
0809 06:55:56.763220 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:55:56.764705 27971 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:56.857015 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 27840
I20260809 06:55:56.876735 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 27453
I20260809 06:55:56.877945 27521 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:55:56.992027 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 27453
I20260809 06:56:17.019284 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44851
--webserver_interface=127.10.205.126
--webserver_port=43081
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:44851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:56:17.381886 28028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:56:17.382170 28028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:56:17.382262 28028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:56:17.389464 28028 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 06:56:17.389566 28028 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 06:56:17.389605 28028 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 06:56:17.389650 28028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:56:17.389696 28028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:56:17.389763 28028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:56:17.389806 28028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:56:17.389854 28028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:56:17.399590 28028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:44851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=43081
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:56:17.400903 28028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:56:17.402235 28028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:56:17.428356 28034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:17.428452 28035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:17.428484 28037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:56:17.428900 28028 server_base.cc:1034] running on GCE node
I20260809 06:56:17.430203 28028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:56:17.431962 28028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:56:17.433226 28028 hybrid_clock.cc:648] HybridClock initialized: now 1786258577433137 us; error 62 us; skew 500 ppm
I20260809 06:56:17.433758 28028 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:56:17 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258577, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:56:17.437481 28028 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:56:17.439312 28028 webserver.cc:460] Webserver started at http://127.10.205.126:43081/ using document root <none> and password file <none>
I20260809 06:56:17.440089 28028 fs_manager.cc:359] Metadata directory not provided
I20260809 06:56:17.440207 28028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:56:17.446486 28028 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:56:17.449491 28045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:17.450866 28028 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:56:17.451043 28028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "033938dfcf7446b0ba0a0c7fc0d72c71"
format_stamp: "Formatted at 2026-08-09 06:55:54 on dist-test-slave-0b58"
server_key: "bd29a27c2e8759b7391c7349767c9561"
server_key_iv: "dd644f9fc991b7f0f98b2498ad11b29c"
server_key_version: "encryptionkey@0"
I20260809 06:56:17.452152 28028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:56:17.483124 28028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:56:17.487537 28028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:56:17.487891 28028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:56:17.507836 28028 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:44851
I20260809 06:56:17.507848 28099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:44851 every 8 connection(s)
I20260809 06:56:17.509531 28028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:56:17.512948 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 28028
I20260809 06:56:17.514068 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:33437
--local_ip_for_outbound_sockets=127.10.205.65
--tserver_master_addrs=127.10.205.126:44851
--webserver_port=42633
--webserver_interface=127.10.205.65
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:56:17.518901 28100 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:56:17.524497 28100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Bootstrap starting.
I20260809 06:56:17.545822 28100 log.cc:824] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Log is configured to *not* fsync() on all Append() calls
I20260809 06:56:17.558843 28100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:56:17.559419 28100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Bootstrap complete.
I20260809 06:56:17.569391 28100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } }
I20260809 06:56:17.570250 28100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033938dfcf7446b0ba0a0c7fc0d72c71, State: Initialized, Role: FOLLOWER
I20260809 06:56:17.571017 28100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } }
I20260809 06:56:17.571265 28100 raft_consensus.cc:388] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:56:17.571398 28100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:56:17.571589 28100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 1 FOLLOWER]: Advancing to term 2
I20260809 06:56:17.575621 28100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } }
I20260809 06:56:17.576192 28100 leader_election.cc:302] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 033938dfcf7446b0ba0a0c7fc0d72c71; no voters:
I20260809 06:56:17.576958 28100 leader_election.cc:288] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 06:56:17.577102 28104 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 06:56:17.578527 28104 raft_consensus.cc:686] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 2 LEADER]: Becoming Leader. State: Replica: 033938dfcf7446b0ba0a0c7fc0d72c71, State: Running, Role: LEADER
I20260809 06:56:17.579107 28104 consensus_queue.cc:237] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } }
I20260809 06:56:17.579389 28100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:56:17.581771 28106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 033938dfcf7446b0ba0a0c7fc0d72c71. Latest consensus state: current_term: 2 leader_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } } }
I20260809 06:56:17.582228 28106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: This master's current role is: LEADER
I20260809 06:56:17.582844 28105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } } }
I20260809 06:56:17.583209 28105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: This master's current role is: LEADER
I20260809 06:56:17.587018 28111 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:56:17.597199 28111 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:56:17.599169 28111 catalog_manager.cc:1259] Loaded cluster ID: 8d6e100e8d5b4d71aa19edbf796ceb79
I20260809 06:56:17.599375 28111 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:56:17.604501 28111 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:56:17.606616 28111 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Loaded TSK: 0
I20260809 06:56:17.648185 28111 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Generated new TSK 1
I20260809 06:56:17.648577 28111 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 06:56:17.896075 28102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:56:17.896468 28102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:56:17.896643 28102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:56:17.904789 28102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:56:17.904954 28102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:56:17.905166 28102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:56:17.915452 28102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:33437
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=42633
--tserver_master_addrs=127.10.205.126:44851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:56:17.916963 28102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:56:17.918341 28102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:56:17.933378 28130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:17.933611 28129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:17.934322 28132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:56:17.934562 28102 server_base.cc:1034] running on GCE node
I20260809 06:56:17.935251 28102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:56:17.936432 28102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:56:17.937680 28102 hybrid_clock.cc:648] HybridClock initialized: now 1786258577937622 us; error 50 us; skew 500 ppm
I20260809 06:56:17.938005 28102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:56:17 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258577, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:56:17.941200 28102 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:56:17.942940 28102 webserver.cc:460] Webserver started at http://127.10.205.65:42633/ using document root <none> and password file <none>
I20260809 06:56:17.943639 28102 fs_manager.cc:359] Metadata directory not provided
I20260809 06:56:17.943794 28102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:56:17.949496 28102 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 06:56:17.952374 28139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:17.953758 28102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:56:17.953946 28102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "038fa2d8f0394773bf60b6cd43fe4513"
format_stamp: "Formatted at 2026-08-09 06:55:54 on dist-test-slave-0b58"
server_key: "261a32b206f99e3d97f7441bc7674b3b"
server_key_iv: "a810e925a12fe721c4bc08aa406dd07c"
server_key_version: "encryptionkey@0"
I20260809 06:56:17.954962 28102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:56:17.976593 28102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:56:17.981200 28102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:56:17.981519 28102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:56:17.982487 28102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:56:17.983870 28102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:56:17.984004 28102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:17.984140 28102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:56:17.984227 28102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:18.018868 28102 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:33437
I20260809 06:56:18.018959 28256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:33437 every 8 connection(s)
I20260809 06:56:18.020448 28102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:56:18.027781 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 28102
I20260809 06:56:18.028607 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:37125
--local_ip_for_outbound_sockets=127.10.205.66
--tserver_master_addrs=127.10.205.126:44851
--webserver_port=34387
--webserver_interface=127.10.205.66
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:56:18 dist-test-slave-0b58 krb5kdc[27439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258577, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:56:18.046511 28259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:18.023454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:36873 (local address 127.10.205.126:44851)
0809 06:56:18.024124 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:18.024144 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:18.024690 (+ 546us) server_negotiation.cc:407] Connection header received
0809 06:56:18.026848 (+ 2158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:18.026859 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:18.027272 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:18.027708 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:18.029395 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:18.031406 (+ 2011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:18.033030 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:18.034112 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:18.034336 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:18.038041 (+ 3705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:18.038053 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:18.038073 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:18.038128 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:18.041853 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:18.042873 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:18.042879 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:18.042884 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:18.043059 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:18.043556 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:18.043559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:18.043561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:18.044015 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:18.044247 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:18.045154 (+ 907us) server_negotiation.cc:299] Negotiation successful
0809 06:56:18.045546 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":284,"threads_started":1}
I20260809 06:56:18.047012 28260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:18.023650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:36873)
0809 06:56:18.024516 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:18.024558 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:56:18.026336 (+ 1778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:56:18.027815 (+ 1479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:56:18.027822 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:56:18.028479 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:56:18.029141 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:18.029160 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:18.031562 (+ 2402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:18.031566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:18.032887 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:18.032900 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:18.034459 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:18.034464 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:18.034690 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:18.035450 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:56:18.035478 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:56:18.037722 (+ 2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:56:18.042021 (+ 4299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:56:18.042033 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:56:18.042050 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:56:18.042720 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:56:18.043180 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:56:18.043188 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:56:18.043195 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:56:18.043442 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:56:18.044155 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:56:18.044166 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:56:18.044635 (+ 469us) client_negotiation.cc:769] Sending connection context
0809 06:56:18.044979 (+ 344us) client_negotiation.cc:240] Negotiation successful
0809 06:56:18.045593 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":338,"threads_started":1}
I20260809 06:56:18.050168 28257 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44851
I20260809 06:56:18.050493 28257 heartbeater.cc:464] Registering TS with master...
I20260809 06:56:18.051276 28257 heartbeater.cc:511] Master 127.10.205.126:44851 requested a full tablet report, sending...
I20260809 06:56:18.053783 28063 ts_manager.cc:194] Registered new tserver with Master: 038fa2d8f0394773bf60b6cd43fe4513 (127.10.205.65:33437)
I20260809 06:56:18.056058 28063 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:36873
W20260809 06:56:18.375676 28261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:56:18.375967 28261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:56:18.376077 28261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:56:18.383272 28261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:56:18.383387 28261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:56:18.383502 28261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:56:18.393153 28261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:37125
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=34387
--tserver_master_addrs=127.10.205.126:44851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:56:18.394433 28261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:56:18.395771 28261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:56:18.409610 28267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:18.409642 28268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:18.410363 28271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:56:18.410805 28261 server_base.cc:1034] running on GCE node
I20260809 06:56:18.411475 28261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:56:18.412509 28261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:56:18.413734 28261 hybrid_clock.cc:648] HybridClock initialized: now 1786258578413688 us; error 60 us; skew 500 ppm
I20260809 06:56:18.414062 28261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:56:18 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258578, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:56:18.417270 28261 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:56:18.418928 28261 webserver.cc:460] Webserver started at http://127.10.205.66:34387/ using document root <none> and password file <none>
I20260809 06:56:18.419612 28261 fs_manager.cc:359] Metadata directory not provided
I20260809 06:56:18.419777 28261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:56:18.425209 28261 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:56:18.427896 28278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:18.429253 28261 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:56:18.429430 28261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a"
format_stamp: "Formatted at 2026-08-09 06:55:55 on dist-test-slave-0b58"
server_key: "f6cf17e53a9d02bea71de779199b06e3"
server_key_iv: "659121efa3e2a1caa3f2f007baf383e0"
server_key_version: "encryptionkey@0"
I20260809 06:56:18.430402 28261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:56:18.461019 28261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:56:18.465507 28261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:56:18.465842 28261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:56:18.466917 28261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:56:18.468405 28261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:56:18.468529 28261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:18.468664 28261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:56:18.468765 28261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:18.504235 28261 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:37125
I20260809 06:56:18.504313 28395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:37125 every 8 connection(s)
I20260809 06:56:18.505780 28261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:56:18.515607 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 28261
I20260809 06:56:18.516541 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:37453
--local_ip_for_outbound_sockets=127.10.205.67
--tserver_master_addrs=127.10.205.126:44851
--webserver_port=41357
--webserver_interface=127.10.205.67
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:56:18 dist-test-slave-0b58 krb5kdc[27439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258578, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:56:18.536541 28259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:18.508527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:53641 (local address 127.10.205.126:44851)
0809 06:56:18.508755 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:18.508762 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:18.516632 (+ 7870us) server_negotiation.cc:407] Connection header received
0809 06:56:18.519449 (+ 2817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:18.519458 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:18.519585 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:18.519713 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:18.521852 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:18.523042 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:18.525137 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:18.525931 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:18.526086 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:18.530208 (+ 4122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:18.530213 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:18.530217 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:18.530251 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:18.532865 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:18.533755 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:18.533759 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:18.533761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:18.533917 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:18.534444 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:18.534449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:18.534452 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:18.534788 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:18.534954 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:18.535934 (+ 980us) server_negotiation.cc:299] Negotiation successful
0809 06:56:18.536144 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 06:56:18.538097 28398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:18.509063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:53641)
0809 06:56:18.516443 (+ 7380us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:18.516496 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 06:56:18.519080 (+ 2584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:56:18.520017 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:56:18.520033 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:56:18.520807 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:56:18.521630 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:18.521656 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:18.523233 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:18.523239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:18.524986 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:18.524999 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:18.526166 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:18.526171 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:18.526386 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:18.527130 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:56:18.527154 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:56:18.529947 (+ 2793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:56:18.533030 (+ 3083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:56:18.533039 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:56:18.533058 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:56:18.533599 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:56:18.534098 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:56:18.534103 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:56:18.534107 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:56:18.534318 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:56:18.534928 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:56:18.534936 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:56:18.535455 (+ 519us) client_negotiation.cc:769] Sending connection context
0809 06:56:18.536346 (+ 891us) client_negotiation.cc:240] Negotiation successful
0809 06:56:18.536975 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7020,"thread_start_us":6816,"threads_started":1}
I20260809 06:56:18.539645 28396 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44851
I20260809 06:56:18.539969 28396 heartbeater.cc:464] Registering TS with master...
I20260809 06:56:18.540817 28396 heartbeater.cc:511] Master 127.10.205.126:44851 requested a full tablet report, sending...
I20260809 06:56:18.542382 28063 ts_manager.cc:194] Registered new tserver with Master: 38d3d0ac1bb04f03ac6b1ee9af035e2a (127.10.205.66:37125)
I20260809 06:56:18.543246 28063 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:53641
W20260809 06:56:18.873912 28399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:56:18.874255 28399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:56:18.874434 28399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:56:18.882040 28399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:56:18.882202 28399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:56:18.882400 28399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:56:18.892354 28399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:37453
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=41357
--tserver_master_addrs=127.10.205.126:44851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:56:18.893842 28399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:56:18.895275 28399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:56:18.909296 28404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:18.909387 28405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:18.909389 28407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:56:18.910334 28399 server_base.cc:1034] running on GCE node
I20260809 06:56:18.910984 28399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:56:18.911978 28399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:56:18.913199 28399 hybrid_clock.cc:648] HybridClock initialized: now 1786258578913151 us; error 63 us; skew 500 ppm
I20260809 06:56:18.913530 28399 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:56:18 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258578, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:56:18.916716 28399 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:56:18.918248 28399 webserver.cc:460] Webserver started at http://127.10.205.67:41357/ using document root <none> and password file <none>
I20260809 06:56:18.918994 28399 fs_manager.cc:359] Metadata directory not provided
I20260809 06:56:18.919158 28399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:56:18.924753 28399 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 06:56:18.927619 28416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:18.929106 28399 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:56:18.929301 28399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "b4232a90fa32411487bed9581875cc21"
format_stamp: "Formatted at 2026-08-09 06:55:55 on dist-test-slave-0b58"
server_key: "fe45753ea85946235e144a1a826ffa48"
server_key_iv: "67feeaf5e43f641c66ec86d2a2c3c9b3"
server_key_version: "encryptionkey@0"
I20260809 06:56:18.930317 28399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:56:18.956916 28399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:56:18.961997 28399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:56:18.962311 28399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:56:18.963407 28399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:56:18.964881 28399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:56:18.965027 28399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:18.965148 28399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:56:18.965234 28399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:18.999934 28399 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:37453
I20260809 06:56:19.000021 28533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:37453 every 8 connection(s)
I20260809 06:56:19.001571 28399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:56:19.010200 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 28399
Aug 09 06:56:19 dist-test-slave-0b58 krb5kdc[27439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258578, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:56:19.022948 28259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.004045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:42997 (local address 127.10.205.126:44851)
0809 06:56:19.004285 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.004291 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.005374 (+ 1083us) server_negotiation.cc:407] Connection header received
0809 06:56:19.007235 (+ 1861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.007241 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.007344 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.007456 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:19.008964 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.009703 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.011802 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.012275 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.012434 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.015861 (+ 3427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:19.015865 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:19.015868 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:19.015901 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:19.019132 (+ 3231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:19.020079 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:19.020086 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:19.020092 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:19.020222 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:19.020691 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:19.020699 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:19.020703 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:19.021128 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:19.021270 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:19.022152 (+ 882us) server_negotiation.cc:299] Negotiation successful
0809 06:56:19.022419 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":61}
I20260809 06:56:19.023900 28536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.004504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:42997)
0809 06:56:19.005190 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.005247 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 06:56:19.006960 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:56:19.007698 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:56:19.007707 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:56:19.008190 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:56:19.008782 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:19.008800 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.009871 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.009882 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:19.011630 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:19.011648 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.012506 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.012514 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:19.012757 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.013477 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:56:19.013498 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:56:19.015645 (+ 2147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:56:19.019307 (+ 3662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:56:19.019314 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:56:19.019331 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:56:19.019954 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:56:19.020377 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:56:19.020383 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:56:19.020386 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:56:19.020572 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:56:19.021312 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:56:19.021320 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:56:19.021733 (+ 413us) client_negotiation.cc:769] Sending connection context
0809 06:56:19.022036 (+ 303us) client_negotiation.cc:240] Negotiation successful
0809 06:56:19.022571 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":273,"threads_started":1}
I20260809 06:56:19.025440 28534 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44851
I20260809 06:56:19.025827 28534 heartbeater.cc:464] Registering TS with master...
I20260809 06:56:19.026626 28537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.011155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39380 (local address 127.10.205.126:44851)
0809 06:56:19.011664 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.011671 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.011985 (+ 314us) server_negotiation.cc:407] Connection header received
0809 06:56:19.012172 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.012182 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.012237 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.012364 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:19.014087 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.014842 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.016213 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.016707 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.016893 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.019540 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:19.019551 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:19.019554 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:19.019582 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:19.023412 (+ 3830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:19.024330 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:19.024334 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:19.024336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:19.024488 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:19.025109 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:19.025114 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:19.025118 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:19.025388 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:19.025709 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:19.026013 (+ 304us) server_negotiation.cc:299] Negotiation successful
0809 06:56:19.026251 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":381,"thread_start_us":255,"threads_started":1}
I20260809 06:56:19.026623 28534 heartbeater.cc:511] Master 127.10.205.126:44851 requested a full tablet report, sending...
I20260809 06:56:19.028132 28063 ts_manager.cc:194] Registered new tserver with Master: b4232a90fa32411487bed9581875cc21 (127.10.205.67:37453)
I20260809 06:56:19.029055 28063 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:42997
I20260809 06:56:19.029408 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:56:19.036228 28537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.030519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39390 (local address 127.10.205.126:44851)
0809 06:56:19.030747 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.030753 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.031108 (+ 355us) server_negotiation.cc:407] Connection header received
0809 06:56:19.031300 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.031303 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.031426 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.031539 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:56:19.032096 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.032830 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.034467 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.034905 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.035064 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.035519 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:56:19.035727 (+ 208us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 06:56:19.035991 (+ 264us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39390: token expired
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 06:56:19.036389 28537 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39390: token expired
W20260809 06:56:19.037076 27983 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.205.126:44851)
I20260809 06:56:19.049961 28537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.037563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39396 (local address 127.10.205.126:44851)
0809 06:56:19.037718 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.037722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.037774 (+ 52us) server_negotiation.cc:407] Connection header received
0809 06:56:19.037900 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.037904 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.037954 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.038024 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:19.039541 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.040191 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.041708 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.042099 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.042195 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.044795 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:19.044800 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:19.044803 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:19.044835 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:19.047570 (+ 2735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:19.048165 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:19.048168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:19.048170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:19.048343 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:19.048667 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:19.048688 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:19.048690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:19.049015 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:19.049186 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:19.049441 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 06:56:19.049605 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:56:19.053314 28063 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39396:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 06:56:19.059513 28257 heartbeater.cc:503] Master 127.10.205.126:44851 was elected leader, sending a full tablet report...
W20260809 06:56:19.061247 28063 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:56:19.084216 28548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.074034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42452 (local address 127.10.205.65:33437)
0809 06:56:19.074720 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.074728 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.075431 (+ 703us) server_negotiation.cc:407] Connection header received
0809 06:56:19.075740 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.075750 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.075963 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.076130 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:56:19.077032 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.078470 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.080955 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.082440 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.082576 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.082813 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:19.083636 (+ 823us) server_negotiation.cc:299] Negotiation successful
0809 06:56:19.083831 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":362,"threads_started":1}
I20260809 06:56:19.085155 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.073231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39848 (local address 127.10.205.66:37125)
0809 06:56:19.073899 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.073911 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.074722 (+ 811us) server_negotiation.cc:407] Connection header received
0809 06:56:19.074831 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.074837 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.075120 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.075314 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:56:19.076318 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.077954 (+ 1636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.080908 (+ 2954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.082440 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.082589 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.082792 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:19.084760 (+ 1968us) server_negotiation.cc:299] Negotiation successful
0809 06:56:19.084919 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":342,"threads_started":1}
I20260809 06:56:19.085157 28549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.073230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33437 (local address 127.0.0.1:42452)
0809 06:56:19.075317 (+ 2087us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.075341 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:56:19.075534 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:56:19.076449 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:56:19.076454 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:56:19.076479 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:56:19.076853 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:19.076864 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.078683 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.078689 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:19.080787 (+ 2098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:19.080801 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.083014 (+ 2213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.083019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:19.083282 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.083369 (+ 87us) client_negotiation.cc:769] Sending connection context
0809 06:56:19.084588 (+ 1219us) client_negotiation.cc:240] Negotiation successful
0809 06:56:19.084779 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1944,"mutex_wait_us":38,"thread_start_us":10183,"threads_started":1}
I20260809 06:56:19.085920 28544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.072945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:37125 (local address 127.0.0.1:39848)
0809 06:56:19.074237 (+ 1292us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.074315 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0809 06:56:19.074516 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:56:19.075593 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:56:19.075601 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:56:19.075630 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:56:19.076066 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:19.076084 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.078107 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.078112 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:19.080701 (+ 2589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:19.080722 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.082986 (+ 2264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.082998 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:19.084038 (+ 1040us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.084074 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:56:19.085361 (+ 1287us) client_negotiation.cc:240] Negotiation successful
0809 06:56:19.085502 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1102,"mutex_wait_us":765,"thread_start_us":982,"threads_started":1}
I20260809 06:56:19.089663 28329 tablet_service.cc:1467] Processing CreateTablet for tablet 0a6d9bd6487944a899047252295a1285 (DEFAULT_TABLE table=test-table [id=effa05ebdea042d1b6c3de2a935af930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:56:19.089663 28189 tablet_service.cc:1467] Processing CreateTablet for tablet 0a6d9bd6487944a899047252295a1285 (DEFAULT_TABLE table=test-table [id=effa05ebdea042d1b6c3de2a935af930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:56:19.091212 28329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a6d9bd6487944a899047252295a1285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:56:19.091236 28189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a6d9bd6487944a899047252295a1285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:56:19.091862 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.074717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37453 (local address 127.0.0.1:36650)
0809 06:56:19.083754 (+ 9037us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.083785 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 06:56:19.083895 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:56:19.085599 (+ 1704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:56:19.085622 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:56:19.085662 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:56:19.086085 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:19.086097 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.087814 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.087821 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:19.089665 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:19.089678 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.091032 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.091038 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:19.091220 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.091267 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 06:56:19.091384 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 06:56:19.091515 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8875,"thread_start_us":813,"threads_started":1}
I20260809 06:56:19.092649 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.075346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36650 (local address 127.10.205.67:37453)
0809 06:56:19.084848 (+ 9502us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.084858 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.084896 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:56:19.084991 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.084999 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.085248 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.085445 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:56:19.086323 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.087649 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.089817 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.090811 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.090974 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.091210 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:19.092089 (+ 879us) server_negotiation.cc:299] Negotiation successful
0809 06:56:19.092324 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9142,"thread_start_us":8971,"threads_started":1}
I20260809 06:56:19.095485 28465 tablet_service.cc:1467] Processing CreateTablet for tablet 0a6d9bd6487944a899047252295a1285 (DEFAULT_TABLE table=test-table [id=effa05ebdea042d1b6c3de2a935af930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:56:19.096995 28465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a6d9bd6487944a899047252295a1285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:56:19.108632 28552 tablet_bootstrap.cc:492] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Bootstrap starting.
I20260809 06:56:19.109460 28551 tablet_bootstrap.cc:492] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: Bootstrap starting.
I20260809 06:56:19.110585 28553 tablet_bootstrap.cc:492] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21: Bootstrap starting.
I20260809 06:56:19.113040 28552 tablet_bootstrap.cc:654] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Neither blocks nor log segments found. Creating new log.
I20260809 06:56:19.113349 28553 tablet_bootstrap.cc:654] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21: Neither blocks nor log segments found. Creating new log.
I20260809 06:56:19.114534 28553 log.cc:824] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21: Log is configured to *not* fsync() on all Append() calls
I20260809 06:56:19.115084 28552 log.cc:824] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Log is configured to *not* fsync() on all Append() calls
I20260809 06:56:19.115711 28551 tablet_bootstrap.cc:654] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: Neither blocks nor log segments found. Creating new log.
I20260809 06:56:19.117076 28551 log.cc:824] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: Log is configured to *not* fsync() on all Append() calls
I20260809 06:56:19.118536 28552 tablet_bootstrap.cc:492] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: No bootstrap required, opened a new log
I20260809 06:56:19.118536 28553 tablet_bootstrap.cc:492] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21: No bootstrap required, opened a new log
I20260809 06:56:19.118829 28553 ts_tablet_manager.cc:1397] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260809 06:56:19.118831 28552 ts_tablet_manager.cc:1397] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260809 06:56:19.119822 28551 tablet_bootstrap.cc:492] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: No bootstrap required, opened a new log
I20260809 06:56:19.120081 28551 ts_tablet_manager.cc:1397] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260809 06:56:19.127499 28551 raft_consensus.cc:348] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } }
I20260809 06:56:19.127914 28551 raft_consensus.cc:374] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:56:19.128058 28551 raft_consensus.cc:729] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038fa2d8f0394773bf60b6cd43fe4513, State: Initialized, Role: FOLLOWER
I20260809 06:56:19.129055 28551 consensus_queue.cc:260] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } }
I20260809 06:56:19.129824 28552 raft_consensus.cc:348] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } }
I20260809 06:56:19.129820 28553 raft_consensus.cc:348] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } }
I20260809 06:56:19.130280 28553 raft_consensus.cc:374] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:56:19.130303 28552 raft_consensus.cc:374] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:56:19.130401 28552 raft_consensus.cc:729] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38d3d0ac1bb04f03ac6b1ee9af035e2a, State: Initialized, Role: FOLLOWER
I20260809 06:56:19.130420 28553 raft_consensus.cc:729] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4232a90fa32411487bed9581875cc21, State: Initialized, Role: FOLLOWER
I20260809 06:56:19.130973 28551 ts_tablet_manager.cc:1428] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260809 06:56:19.131102 28552 consensus_queue.cc:260] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } }
I20260809 06:56:19.131106 28553 consensus_queue.cc:260] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } }
I20260809 06:56:19.133049 28396 heartbeater.cc:503] Master 127.10.205.126:44851 was elected leader, sending a full tablet report...
I20260809 06:56:19.133350 28553 ts_tablet_manager.cc:1428] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21: Time spent starting tablet: real 0.014s user 0.015s sys 0.001s
I20260809 06:56:19.133587 28552 ts_tablet_manager.cc:1428] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Time spent starting tablet: real 0.015s user 0.016s sys 0.001s
I20260809 06:56:19.134577 28534 heartbeater.cc:503] Master 127.10.205.126:44851 was elected leader, sending a full tablet report...
I20260809 06:56:19.236645 28558 raft_consensus.cc:482] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:56:19.237015 28558 raft_consensus.cc:504] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } }
I20260809 06:56:19.239027 28558 leader_election.cc:288] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38d3d0ac1bb04f03ac6b1ee9af035e2a (127.10.205.66:37125), 038fa2d8f0394773bf60b6cd43fe4513 (127.10.205.65:33437)
I20260809 06:56:19.245360 28536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.239208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:37125 (local address 127.10.205.67:51765)
0809 06:56:19.239705 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.239727 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:56:19.239859 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:56:19.240652 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:56:19.240657 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:56:19.240684 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:56:19.240863 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:19.240871 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.241815 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.241820 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:19.243130 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:19.243164 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.244570 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.244575 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:19.244783 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.244820 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 06:56:19.244943 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 06:56:19.245094 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337}
I20260809 06:56:19.245424 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.240177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:51765 (local address 127.10.205.66:37125)
0809 06:56:19.240392 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.240396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.240411 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:56:19.240469 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.240472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.240527 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.240631 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:56:19.240989 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.241687 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.243330 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.244412 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.244542 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.244609 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:19.244982 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 06:56:19.245173 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:56:19.245945 28548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.239734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:46373 (local address 127.10.205.65:33437)
0809 06:56:19.240003 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.240011 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.240464 (+ 453us) server_negotiation.cc:407] Connection header received
0809 06:56:19.240662 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.240667 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.240744 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.240838 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:56:19.241351 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.242032 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.243934 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.244954 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.245091 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.245154 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:19.245528 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 06:56:19.245678 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260809 06:56:19.246479 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.239479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33437 (local address 127.10.205.67:46373)
0809 06:56:19.240357 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.240372 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:56:19.240518 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:56:19.240855 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:56:19.240859 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:56:19.240881 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:56:19.241210 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:19.241218 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.242185 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.242194 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:19.243776 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:19.243791 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.245144 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.245150 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:19.245325 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.245357 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:56:19.246147 (+ 790us) client_negotiation.cc:240] Negotiation successful
0809 06:56:19.246240 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":533,"threads_started":1}
I20260809 06:56:19.246582 28349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a6d9bd6487944a899047252295a1285" candidate_uuid: "b4232a90fa32411487bed9581875cc21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" is_pre_election: true
I20260809 06:56:19.247116 28349 raft_consensus.cc:2454] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4232a90fa32411487bed9581875cc21 in term 0.
I20260809 06:56:19.247695 28210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a6d9bd6487944a899047252295a1285" candidate_uuid: "b4232a90fa32411487bed9581875cc21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038fa2d8f0394773bf60b6cd43fe4513" is_pre_election: true
I20260809 06:56:19.247895 28420 leader_election.cc:302] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38d3d0ac1bb04f03ac6b1ee9af035e2a, b4232a90fa32411487bed9581875cc21; no voters:
I20260809 06:56:19.248319 28210 raft_consensus.cc:2454] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4232a90fa32411487bed9581875cc21 in term 0.
I20260809 06:56:19.248387 28558 raft_consensus.cc:2781] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:56:19.248533 28558 raft_consensus.cc:482] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:56:19.248668 28558 raft_consensus.cc:3037] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:56:19.250962 28558 raft_consensus.cc:504] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } }
I20260809 06:56:19.251632 28558 leader_election.cc:288] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [CANDIDATE]: Term 1 election: Requested vote from peers 38d3d0ac1bb04f03ac6b1ee9af035e2a (127.10.205.66:37125), 038fa2d8f0394773bf60b6cd43fe4513 (127.10.205.65:33437)
I20260809 06:56:19.252003 28349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a6d9bd6487944a899047252295a1285" candidate_uuid: "b4232a90fa32411487bed9581875cc21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a"
I20260809 06:56:19.252179 28349 raft_consensus.cc:3037] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:56:19.252094 28210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a6d9bd6487944a899047252295a1285" candidate_uuid: "b4232a90fa32411487bed9581875cc21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "038fa2d8f0394773bf60b6cd43fe4513"
I20260809 06:56:19.252388 28210 raft_consensus.cc:3037] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513 [term 0 FOLLOWER]: Advancing to term 1
W20260809 06:56:19.253182 28535 tablet.cc:2369] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:56:19.254395 28349 raft_consensus.cc:2454] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4232a90fa32411487bed9581875cc21 in term 1.
I20260809 06:56:19.254778 28420 leader_election.cc:302] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38d3d0ac1bb04f03ac6b1ee9af035e2a, b4232a90fa32411487bed9581875cc21; no voters:
I20260809 06:56:19.255070 28558 raft_consensus.cc:2781] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:56:19.255489 28210 raft_consensus.cc:2454] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4232a90fa32411487bed9581875cc21 in term 1.
I20260809 06:56:19.255586 28558 raft_consensus.cc:686] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 1 LEADER]: Becoming Leader. State: Replica: b4232a90fa32411487bed9581875cc21, State: Running, Role: LEADER
I20260809 06:56:19.256202 28558 consensus_queue.cc:237] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } } peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } }
W20260809 06:56:19.257855 28397 tablet.cc:2369] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:56:19.261160 28063 catalog_manager.cc:5495] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4232a90fa32411487bed9581875cc21 (127.10.205.67). New cstate: current_term: 1 leader_uuid: "b4232a90fa32411487bed9581875cc21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4232a90fa32411487bed9581875cc21" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37453 } health_report { overall_health: HEALTHY } } }
W20260809 06:56:19.273258 28258 tablet.cc:2369] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:56:19.289841 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.283961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36660 (local address 127.10.205.67:37453)
0809 06:56:19.284163 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.284167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.284184 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:56:19.284394 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.284398 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.284484 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.284607 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:56:19.284921 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.285661 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.287871 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.288296 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.288392 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.288864 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:56:19.289363 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:56:19.289471 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:19.289564 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 06:56:19.289633 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 06:56:19.297850 28349 raft_consensus.cc:1261] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 1 FOLLOWER]: Refusing update from remote peer b4232a90fa32411487bed9581875cc21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:56:19.297854 28210 raft_consensus.cc:1261] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513 [term 1 FOLLOWER]: Refusing update from remote peer b4232a90fa32411487bed9581875cc21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:56:19.298838 28561 consensus_queue.cc:1035] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:56:19.299201 28558 consensus_queue.cc:1035] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "038fa2d8f0394773bf60b6cd43fe4513" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:56:19.328888 28063 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:56:19.329259 28063 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:56:19.332863 28063 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Sending DeleteTablet for 3 replicas of tablet 0a6d9bd6487944a899047252295a1285
I20260809 06:56:19.334354 28189 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a6d9bd6487944a899047252295a1285 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:56:19 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:42452
I20260809 06:56:19.334383 28329 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a6d9bd6487944a899047252295a1285 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:56:19 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:39848
I20260809 06:56:19.334708 28465 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a6d9bd6487944a899047252295a1285 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:56:19 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:36650
I20260809 06:56:19.335986 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 28102
I20260809 06:56:19.344513 28577 tablet_replica.cc:330] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21: stopping tablet replica
I20260809 06:56:19.345214 28577 raft_consensus.cc:2229] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:56:19.346076 28577 raft_consensus.cc:2258] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:56:19.346861 28575 tablet_replica.cc:330] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: stopping tablet replica
I20260809 06:56:19.347295 28575 raft_consensus.cc:2229] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:56:19.347855 28575 raft_consensus.cc:2258] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:56:19.348465 28576 tablet_replica.cc:330] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: stopping tablet replica
I20260809 06:56:19.348891 28577 ts_tablet_manager.cc:1905] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:56:19.348977 28576 raft_consensus.cc:2229] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:56:19.349550 28576 raft_consensus.cc:2258] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:56:19.352408 28576 ts_tablet_manager.cc:1905] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:56:19.354156 28575 ts_tablet_manager.cc:1905] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:56:19.357270 28577 ts_tablet_manager.cc:1918] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:56:19.357471 28577 log.cc:1196] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/0a6d9bd6487944a899047252295a1285
I20260809 06:56:19.358115 28577 ts_tablet_manager.cc:1939] T 0a6d9bd6487944a899047252295a1285 P b4232a90fa32411487bed9581875cc21: Deleting consensus metadata
I20260809 06:56:19.358484 28548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.337620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42454 (local address 127.10.205.65:33437)
0809 06:56:19.337818 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.337826 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.337844 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:56:19.337906 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.337912 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.337996 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.338092 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:19.340334 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.341496 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.343637 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.344364 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.344507 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.349955 (+ 5448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:19.349975 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:19.349992 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:19.350042 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:19.354081 (+ 4039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:19.355244 (+ 1163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:19.355253 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:19.355257 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:19.355447 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:19.355954 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:19.355960 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:19.355963 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:19.356561 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:19.356915 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:19.357640 (+ 725us) server_negotiation.cc:299] Negotiation successful
0809 06:56:19.357919 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 06:56:19.360114 28049 catalog_manager.cc:4841] TS b4232a90fa32411487bed9581875cc21 (127.10.205.67:37453): tablet 0a6d9bd6487944a899047252295a1285 (table test-table [id=effa05ebdea042d1b6c3de2a935af930]) successfully deleted
I20260809 06:56:19.360338 28252 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:56:19.366097 28576 ts_tablet_manager.cc:1918] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:56:19.366302 28576 log.cc:1196] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/0a6d9bd6487944a899047252295a1285
I20260809 06:56:19.366921 28576 ts_tablet_manager.cc:1939] T 0a6d9bd6487944a899047252295a1285 P 38d3d0ac1bb04f03ac6b1ee9af035e2a: Deleting consensus metadata
I20260809 06:56:19.368933 28049 catalog_manager.cc:4841] TS 38d3d0ac1bb04f03ac6b1ee9af035e2a (127.10.205.66:37125): tablet 0a6d9bd6487944a899047252295a1285 (table test-table [id=effa05ebdea042d1b6c3de2a935af930]) successfully deleted
I20260809 06:56:19.451895 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 28102
W20260809 06:56:19.480664 28047 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.205.65:33437 (error 108)
I20260809 06:56:19.480803 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 28261
I20260809 06:56:19.483850 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.483416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33437 (local address 127.0.0.1:42470)
0809 06:56:19.483610 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.483707 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 06:56:19.484403 28047 catalog_manager.cc:4584] TS 038fa2d8f0394773bf60b6cd43fe4513 (127.10.205.65:33437): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0a6d9bd6487944a899047252295a1285: Network error: Client connection negotiation failed: client connection to 127.10.205.65:33437: connect: Connection refused (error 111)
I20260809 06:56:19.498046 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.481761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39850 (local address 127.10.205.66:37125)
0809 06:56:19.481962 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.481968 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.482231 (+ 263us) server_negotiation.cc:407] Connection header received
0809 06:56:19.482478 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.482485 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.482588 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.482705 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:19.485033 (+ 2328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.485820 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.487844 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.488242 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.488407 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.492005 (+ 3598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:19.492019 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:19.492035 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:19.492068 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:19.495120 (+ 3052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:19.495973 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:19.495980 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:19.495982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:19.496119 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:19.496594 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:19.496600 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:19.496604 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:19.497001 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:19.497247 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:19.497579 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 06:56:19.497754 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:56:19.498808 28391 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:56:19.538214 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.537579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33437 (local address 127.0.0.1:42486)
0809 06:56:19.537875 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.538002 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
I20260809 06:56:19.539431 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.539007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33437 (local address 127.0.0.1:42500)
0809 06:56:19.539174 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.539266 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 06:56:19.590350 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 28261
I20260809 06:56:19.600419 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.599756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33437 (local address 127.0.0.1:42504)
0809 06:56:19.600075 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.600185 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260809 06:56:19.601776 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.601291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33437 (local address 127.0.0.1:42514)
0809 06:56:19.601494 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.601600 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 06:56:19.612383 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 28399
I20260809 06:56:19.630707 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.613446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36664 (local address 127.10.205.67:37453)
0809 06:56:19.613632 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:19.613637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:19.613657 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:56:19.613783 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:19.613787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:19.613854 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:19.613941 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:19.615872 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.616884 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.618842 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:19.619302 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:19.619396 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:19.623074 (+ 3678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:19.623086 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:19.623103 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:19.623189 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:19.626589 (+ 3400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:19.627522 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:19.627529 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:19.627532 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:19.627696 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:19.628223 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:19.628233 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:19.628238 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:19.628783 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:19.629121 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:19.629823 (+ 702us) server_negotiation.cc:299] Negotiation successful
0809 06:56:19.630172 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:56:19.632241 28528 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:56:19.682461 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.681939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33437 (local address 127.0.0.1:42518)
0809 06:56:19.682157 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.682265 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 06:56:19.683561 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.683193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33437 (local address 127.0.0.1:42532)
0809 06:56:19.683387 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.683459 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260809 06:56:19.756147 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 28399
I20260809 06:56:19.778815 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 28028
I20260809 06:56:19.780112 28095 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:56:19.896703 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 28028
I20260809 06:56:19.896740 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:19.895743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33437 (local address 127.0.0.1:42548)
0809 06:56:19.895937 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:19.896063 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 06:56:39.923394 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44851
--webserver_interface=127.10.205.126
--webserver_port=43081
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:44851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:56:40.272571 28583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:56:40.272864 28583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:56:40.273046 28583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:56:40.280144 28583 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 06:56:40.280287 28583 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 06:56:40.280328 28583 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 06:56:40.280375 28583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:56:40.280476 28583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:56:40.280607 28583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:56:40.280663 28583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:56:40.280762 28583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:56:40.290714 28583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:44851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=43081
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:56:40.291914 28583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:56:40.293232 28583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:56:40.305177 28588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:40.305203 28591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:40.305238 28589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:56:40.306387 28583 server_base.cc:1034] running on GCE node
I20260809 06:56:40.307137 28583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:56:40.308586 28583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:56:40.309947 28583 hybrid_clock.cc:648] HybridClock initialized: now 1786258600309874 us; error 38 us; skew 500 ppm
I20260809 06:56:40.310324 28583 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:56:40 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258600, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:56:40.317734 28583 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:56:40.319363 28583 webserver.cc:460] Webserver started at http://127.10.205.126:43081/ using document root <none> and password file <none>
I20260809 06:56:40.320128 28583 fs_manager.cc:359] Metadata directory not provided
I20260809 06:56:40.320315 28583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:56:40.325683 28583 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:56:40.328481 28598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:40.329768 28583 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:56:40.329959 28583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "033938dfcf7446b0ba0a0c7fc0d72c71"
format_stamp: "Formatted at 2026-08-09 06:55:54 on dist-test-slave-0b58"
server_key: "bd29a27c2e8759b7391c7349767c9561"
server_key_iv: "dd644f9fc991b7f0f98b2498ad11b29c"
server_key_version: "encryptionkey@0"
I20260809 06:56:40.330927 28583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:56:40.358757 28583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:56:40.362893 28583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:56:40.363189 28583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:56:40.381692 28583 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:44851
I20260809 06:56:40.381727 28655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:44851 every 8 connection(s)
I20260809 06:56:40.383062 28583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:56:40.386996 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 28583
I20260809 06:56:40.388064 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:33437
--local_ip_for_outbound_sockets=127.10.205.65
--tserver_master_addrs=127.10.205.126:44851
--webserver_port=42633
--webserver_interface=127.10.205.65
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:56:40.390647 28656 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:56:40.395505 28656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Bootstrap starting.
I20260809 06:56:40.416877 28656 log.cc:824] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Log is configured to *not* fsync() on all Append() calls
I20260809 06:56:40.433389 28656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:56:40.433926 28656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Bootstrap complete.
I20260809 06:56:40.443382 28656 raft_consensus.cc:348] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } }
I20260809 06:56:40.444308 28656 raft_consensus.cc:729] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033938dfcf7446b0ba0a0c7fc0d72c71, State: Initialized, Role: FOLLOWER
I20260809 06:56:40.444903 28656 consensus_queue.cc:260] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } }
I20260809 06:56:40.445137 28656 raft_consensus.cc:388] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:56:40.445269 28656 raft_consensus.cc:482] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:56:40.445434 28656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 2 FOLLOWER]: Advancing to term 3
I20260809 06:56:40.449218 28656 raft_consensus.cc:504] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } }
I20260809 06:56:40.449663 28656 leader_election.cc:302] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 033938dfcf7446b0ba0a0c7fc0d72c71; no voters:
I20260809 06:56:40.450335 28656 leader_election.cc:288] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 06:56:40.450479 28660 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 06:56:40.451547 28660 raft_consensus.cc:686] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [term 3 LEADER]: Becoming Leader. State: Replica: 033938dfcf7446b0ba0a0c7fc0d72c71, State: Running, Role: LEADER
I20260809 06:56:40.452152 28660 consensus_queue.cc:237] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } }
I20260809 06:56:40.452522 28656 sys_catalog.cc:564] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:56:40.454506 28662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 033938dfcf7446b0ba0a0c7fc0d72c71. Latest consensus state: current_term: 3 leader_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } } }
I20260809 06:56:40.454895 28662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: This master's current role is: LEADER
I20260809 06:56:40.454753 28661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033938dfcf7446b0ba0a0c7fc0d72c71" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44851 } } }
I20260809 06:56:40.455159 28661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71 [sys.catalog]: This master's current role is: LEADER
I20260809 06:56:40.465644 28667 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:56:40.475739 28667 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:56:40.477613 28667 catalog_manager.cc:1259] Loaded cluster ID: 8d6e100e8d5b4d71aa19edbf796ceb79
I20260809 06:56:40.477751 28667 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:56:40.482899 28667 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:56:40.484817 28667 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Loaded TSK: 0
I20260809 06:56:40.484978 28667 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 033938dfcf7446b0ba0a0c7fc0d72c71: Loaded TSK: 1
F20260809 06:56:40.486321 28667 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fcb6c7f19ad google::LogMessage::Fail() at ??:0
@ 0x7fcb6c7f488a google::LogMessage::SendToLog() at ??:0
@ 0x7fcb6c7f14de google::LogMessage::Flush() at ??:0
@ 0x7fcb6c7f2a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fcb705557d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fcb7054473e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fcb822201c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fcb8221f783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fcb822ab2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fcb822ab0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fcb822f55e9 std::function<>::operator()() at ??:0
@ 0x7fcb82223cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fcb82221c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fcb822a9610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fcb822a9439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fcb6f43d345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fcb6f44091c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fcb6f440799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fcb6f41beaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fcb726f56db start_thread at ??:0
@ 0x7fcb6b68b61f clone at ??:0
W20260809 06:56:40.777972 28658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:56:40.778236 28658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:56:40.778330 28658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:56:40.785235 28658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:56:40.785341 28658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:56:40.785442 28658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:56:40.794679 28658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:33437
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=42633
--tserver_master_addrs=127.10.205.126:44851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:56:40.795895 28658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:56:40.797101 28658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:56:40.809769 28708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:40.809718 28705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:40.809805 28706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:56:40.810765 28658 server_base.cc:1034] running on GCE node
I20260809 06:56:40.811323 28658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:56:40.812222 28658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:56:40.813467 28658 hybrid_clock.cc:648] HybridClock initialized: now 1786258600813421 us; error 38 us; skew 500 ppm
I20260809 06:56:40.813776 28658 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:56:40 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258600, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:56:40.816756 28658 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:56:40.818164 28658 webserver.cc:460] Webserver started at http://127.10.205.65:42633/ using document root <none> and password file <none>
I20260809 06:56:40.818845 28658 fs_manager.cc:359] Metadata directory not provided
I20260809 06:56:40.818977 28658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:56:40.823853 28658 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:56:40.826516 28715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:40.827756 28658 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 06:56:40.827927 28658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "038fa2d8f0394773bf60b6cd43fe4513"
format_stamp: "Formatted at 2026-08-09 06:55:54 on dist-test-slave-0b58"
server_key: "261a32b206f99e3d97f7441bc7674b3b"
server_key_iv: "a810e925a12fe721c4bc08aa406dd07c"
server_key_version: "encryptionkey@0"
I20260809 06:56:40.828964 28658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:56:40.857591 28658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:56:40.861508 28658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:56:40.861811 28658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:56:40.862808 28658 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:56:40.864538 28723 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260809 06:56:40.869598 28723 ts_tablet_manager.cc:1852] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260809 06:56:40.870496 28723 ts_tablet_manager.cc:1905] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:56:40.877135 28723 ts_tablet_manager.cc:1918] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:56:40.877300 28723 log.cc:1196] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/0a6d9bd6487944a899047252295a1285
I20260809 06:56:40.877734 28723 ts_tablet_manager.cc:1939] T 0a6d9bd6487944a899047252295a1285 P 038fa2d8f0394773bf60b6cd43fe4513: Deleting consensus metadata
I20260809 06:56:40.878075 28658 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260809 06:56:40.878221 28658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.014s user 0.001s sys 0.000s
I20260809 06:56:40.878360 28658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:56:40.878473 28658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:40.911882 28658 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:33437
I20260809 06:56:40.911969 28834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:33437 every 8 connection(s)
I20260809 06:56:40.913293 28658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:56:40.917876 28837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:40.916124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:42689)
0809 06:56:40.916857 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:40.917072 (+ 215us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":318,"threads_started":1}
W20260809 06:56:40.918470 28835 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:44851 (0 consecutive failures): Network error: Failed to ping master at 127.10.205.126:44851: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
I20260809 06:56:40.919199 28837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:40.918908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:36673)
0809 06:56:40.919050 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:40.919108 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 06:56:40.919576 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 28658
I20260809 06:56:40.920047 28837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:40.919657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:58853)
0809 06:56:40.919817 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:40.919902 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260809 06:56:40.920307 28835 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 06:56:40.920432 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:37125
--local_ip_for_outbound_sockets=127.10.205.66
--tserver_master_addrs=127.10.205.126:44851
--webserver_port=34387
--webserver_interface=127.10.205.66
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:56:41.242151 28838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:56:41.242479 28838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:56:41.242641 28838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:56:41.249382 28838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:56:41.249519 28838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:56:41.249689 28838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:56:41.258672 28838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:37125
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=34387
--tserver_master_addrs=127.10.205.126:44851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:56:41.259927 28838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:56:41.261307 28838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:56:41.278554 28843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:41.278487 28844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:41.278530 28846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:56:41.279278 28838 server_base.cc:1034] running on GCE node
I20260809 06:56:41.279871 28838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:56:41.280769 28838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:56:41.281977 28838 hybrid_clock.cc:648] HybridClock initialized: now 1786258601281927 us; error 44 us; skew 500 ppm
I20260809 06:56:41.282267 28838 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:56:41 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258601, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:56:41.285492 28838 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:56:41.286942 28838 webserver.cc:460] Webserver started at http://127.10.205.66:34387/ using document root <none> and password file <none>
I20260809 06:56:41.287613 28838 fs_manager.cc:359] Metadata directory not provided
I20260809 06:56:41.287720 28838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:56:41.292816 28838 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:56:41.295483 28853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:41.296763 28838 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:56:41.296931 28838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "38d3d0ac1bb04f03ac6b1ee9af035e2a"
format_stamp: "Formatted at 2026-08-09 06:55:55 on dist-test-slave-0b58"
server_key: "f6cf17e53a9d02bea71de779199b06e3"
server_key_iv: "659121efa3e2a1caa3f2f007baf383e0"
server_key_version: "encryptionkey@0"
I20260809 06:56:41.297937 28838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:56:41.316892 28838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:56:41.320657 28838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:56:41.320927 28838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:56:41.321816 28838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:56:41.323032 28838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:56:41.323169 28838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:41.323314 28838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:56:41.323427 28838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:41.355963 28838 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:37125
I20260809 06:56:41.356019 28972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:37125 every 8 connection(s)
I20260809 06:56:41.357430 28838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:56:41.358721 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 28838
I20260809 06:56:41.359421 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:37453
--local_ip_for_outbound_sockets=127.10.205.67
--tserver_master_addrs=127.10.205.126:44851
--webserver_port=41357
--webserver_interface=127.10.205.67
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:56:41.362615 28975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:41.360525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:42577)
0809 06:56:41.361346 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:41.361627 (+ 281us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":349,"threads_started":1}
W20260809 06:56:41.369442 28973 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:44851 (0 consecutive failures): Network error: Failed to ping master at 127.10.205.126:44851: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
I20260809 06:56:41.370321 28975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:41.369934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:36103)
0809 06:56:41.370084 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:41.370161 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 06:56:41.371261 28975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:41.370908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:58275)
0809 06:56:41.371066 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:41.371156 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 06:56:41.371450 28973 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 06:56:41.684465 28976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:56:41.684710 28976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:56:41.684795 28976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:56:41.691463 28976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:56:41.691553 28976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:56:41.691654 28976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:56:41.700529 28976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:37453
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=41357
--tserver_master_addrs=127.10.205.126:44851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:56:41.701668 28976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:56:41.702968 28976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:56:41.716189 28985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:41.716292 28982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:41.716292 28983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:56:41.717283 28976 server_base.cc:1034] running on GCE node
I20260809 06:56:41.717931 28976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:56:41.718871 28976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:56:41.720069 28976 hybrid_clock.cc:648] HybridClock initialized: now 1786258601720032 us; error 29 us; skew 500 ppm
I20260809 06:56:41.720389 28976 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:56:41 dist-test-slave-0b58 krb5kdc[27439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258601, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:56:41.730468 28976 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:56:41.732550 28976 webserver.cc:460] Webserver started at http://127.10.205.67:41357/ using document root <none> and password file <none>
I20260809 06:56:41.733536 28976 fs_manager.cc:359] Metadata directory not provided
I20260809 06:56:41.733704 28976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:56:41.741712 28976 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 06:56:41.745042 28993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:41.746675 28976 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:56:41.746863 28976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "b4232a90fa32411487bed9581875cc21"
format_stamp: "Formatted at 2026-08-09 06:55:55 on dist-test-slave-0b58"
server_key: "fe45753ea85946235e144a1a826ffa48"
server_key_iv: "67feeaf5e43f641c66ec86d2a2c3c9b3"
server_key_version: "encryptionkey@0"
I20260809 06:56:41.748353 28976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:56:41.774813 28976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:56:41.779155 28976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:56:41.779374 28976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:56:41.780319 28976 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:56:41.781554 28976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:56:41.781637 28976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:41.781726 28976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:56:41.781777 28976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:41.813148 28976 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:37453
I20260809 06:56:41.813200 29110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:37453 every 8 connection(s)
I20260809 06:56:41.814702 28976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:56:41.819414 29114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:41.817585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:37193)
0809 06:56:41.818321 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:41.818554 (+ 233us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":272,"threads_started":1}
I20260809 06:56:41.819947 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 28976
W20260809 06:56:41.820068 29112 heartbeater.cc:644] Failed to heartbeat to 127.10.205.126:44851 (0 consecutive failures): Network error: Failed to ping master at 127.10.205.126:44851: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
I20260809 06:56:41.820923 29114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:41.820605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:35953)
0809 06:56:41.820748 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:41.820834 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 06:56:41.821895 29114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:41.821537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:51057)
0809 06:56:41.821694 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:41.821780 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 06:56:41.822196 29112 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 06:56:41.921821 29116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:41.920951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:33227)
0809 06:56:41.921488 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:41.921605 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":271,"threads_started":1}
I20260809 06:56:42.372746 29117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:42.371948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:36101)
0809 06:56:42.372418 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:42.372514 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":203,"threads_started":1}
I20260809 06:56:42.823755 29118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:42.822873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:54535)
0809 06:56:42.823377 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:42.823486 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":254,"threads_started":1}
I20260809 06:56:42.923480 29119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:42.922810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:34635)
0809 06:56:42.923238 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:42.923334 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":231,"threads_started":1}
I20260809 06:56:43.374293 29120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:43.373619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:43363)
0809 06:56:43.374047 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:43.374124 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":214,"threads_started":1}
I20260809 06:56:43.825596 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:43.824834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:33853)
0809 06:56:43.825350 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:43.825427 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":273,"threads_started":1}
I20260809 06:56:43.925626 29123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:43.924658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:47499)
0809 06:56:43.925249 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:43.925389 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":381,"threads_started":1}
I20260809 06:56:44.375804 29124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:44.375124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:44155)
0809 06:56:44.375543 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:44.375621 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":224,"threads_started":1}
I20260809 06:56:44.827420 29126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:44.826573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:42099)
0809 06:56:44.827138 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:44.827221 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":330,"threads_started":1}
I20260809 06:56:44.927471 29127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:44.926634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:38607)
0809 06:56:44.927213 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:44.927296 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":281,"threads_started":1}
I20260809 06:56:45.377559 29128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:45.376849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:57045)
0809 06:56:45.377276 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:45.377357 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":207,"threads_started":1}
I20260809 06:56:45.829294 29129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:45.828513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:34765)
0809 06:56:45.829016 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:45.829118 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":256,"threads_started":1}
I20260809 06:56:45.929363 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:45.928622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:52911)
0809 06:56:45.929108 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:45.929187 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":256,"threads_started":1}
I20260809 06:56:46.379524 29131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:46.378660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:50539)
0809 06:56:46.379256 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:46.379350 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":336,"threads_started":1}
I20260809 06:56:46.830974 29132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:46.830156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:39821)
0809 06:56:46.830726 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:46.830808 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":336,"threads_started":1}
I20260809 06:56:46.930933 29133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:46.930257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:59907)
0809 06:56:46.930694 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:46.930776 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":215,"threads_started":1}
I20260809 06:56:47.381256 29134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:47.380565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:42491)
0809 06:56:47.381017 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:47.381103 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":238,"threads_started":1}
I20260809 06:56:47.832657 29135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:47.831929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:35025)
0809 06:56:47.832408 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:47.832499 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":219,"threads_started":1}
I20260809 06:56:47.932751 29136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:47.931869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:47075)
0809 06:56:47.932463 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:47.932541 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":284,"threads_started":1}
I20260809 06:56:48.383055 29137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:48.382300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:33183)
0809 06:56:48.382763 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:48.382842 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":206,"threads_started":1}
I20260809 06:56:48.834523 29138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:48.833701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:52957)
0809 06:56:48.834203 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:48.834296 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":211,"threads_started":1}
I20260809 06:56:48.934444 29139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:48.933611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:46905)
0809 06:56:48.934107 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:48.934191 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":294,"threads_started":1}
I20260809 06:56:49.384954 29140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:49.384198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:51709)
0809 06:56:49.384699 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:49.384789 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":276,"threads_started":1}
I20260809 06:56:49.836239 29142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:49.835533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:51405)
0809 06:56:49.835994 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:49.836076 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":245,"threads_started":1}
I20260809 06:56:49.936014 29143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:49.935275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:50697)
0809 06:56:49.935740 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:49.935849 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":234,"threads_started":1}
I20260809 06:56:50.386617 29144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:50.385839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:48359)
0809 06:56:50.386355 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:50.386439 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":252,"threads_started":1}
I20260809 06:56:50.837888 29145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:50.837139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:48003)
0809 06:56:50.837592 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:50.837685 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":219,"threads_started":1}
I20260809 06:56:50.937623 29146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:50.936942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:50535)
0809 06:56:50.937382 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:50.937461 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":240,"threads_started":1}
I20260809 06:56:51.388233 29147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:51.387535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:33873)
0809 06:56:51.387993 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:51.388072 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":259,"threads_started":1}
I20260809 06:56:51.839519 29148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:51.838811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:58941)
0809 06:56:51.839268 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:51.839352 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":243,"threads_started":1}
I20260809 06:56:51.939366 29149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:51.938606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:55799)
0809 06:56:51.939081 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:51.939171 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":261,"threads_started":1}
I20260809 06:56:52.390044 29150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:52.389281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:44511)
0809 06:56:52.389747 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:52.389857 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":241,"threads_started":1}
I20260809 06:56:52.841459 29151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:52.840711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:41365)
0809 06:56:52.841177 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:52.841275 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":230,"threads_started":1}
I20260809 06:56:52.941254 29152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:52.940534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:43273)
0809 06:56:52.941004 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:52.941092 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":254,"threads_started":1}
I20260809 06:56:53.391839 29153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:53.391093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:48507)
0809 06:56:53.391581 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:53.391666 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":269,"threads_started":1}
I20260809 06:56:53.843171 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:53.842394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:57731)
0809 06:56:53.842938 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:53.843022 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":331,"threads_started":1}
I20260809 06:56:53.942942 29155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:53.942219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:42565)
0809 06:56:53.942651 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:53.942746 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":216,"threads_started":1}
I20260809 06:56:54.393520 29156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:54.392798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:58129)
0809 06:56:54.393249 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:54.393340 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":230,"threads_started":1}
I20260809 06:56:54.845044 29157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:54.844172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:40375)
0809 06:56:54.844752 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:54.844854 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":324,"threads_started":1}
I20260809 06:56:54.944751 29158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:54.943882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:39711)
0809 06:56:54.944466 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:54.944558 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":248,"threads_started":1}
I20260809 06:56:55.395224 29159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:55.394495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:54393)
0809 06:56:55.394916 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:55.395021 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":215,"threads_started":1}
I20260809 06:56:55.846884 29160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:55.845952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:40541)
0809 06:56:55.846520 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:55.846629 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":308,"threads_started":1}
I20260809 06:56:55.946686 29161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:55.945895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.65:39941)
0809 06:56:55.946399 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:55.946502 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":254,"threads_started":1}
I20260809 06:56:56.397158 29162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:56.396426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.66:53689)
0809 06:56:56.396877 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:56.396970 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":241,"threads_started":1}
I20260809 06:56:56.829830 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 28658
I20260809 06:56:56.848974 29164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:56.847992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44851 (local address 127.10.205.67:34847)
0809 06:56:56.848588 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:56.848721 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.126:44851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":320,"threads_started":1}
I20260809 06:56:56.855803 29163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:56.831087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39654 (local address 127.10.205.65:33437)
0809 06:56:56.832052 (+ 965us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:56.832066 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:56.832104 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:56:56.834018 (+ 1914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:56.834027 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:56.834443 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:56.834724 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:56.836216 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:56.837468 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:56.838702 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:56.839400 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:56.839579 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:56.849319 (+ 9740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:56.849329 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:56.849346 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:56.849394 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:56.852380 (+ 2986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:56.853245 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:56.853255 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:56.853275 (+ 20us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:56.853453 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:56.853811 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:56.853814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:56.853816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:56.854413 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:56.854661 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:56.855089 (+ 428us) server_negotiation.cc:299] Negotiation successful
0809 06:56:56.855516 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":809,"thread_start_us":662,"threads_started":1}
I20260809 06:56:56.857352 28829 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:56:56.941584 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 28658
I20260809 06:56:56.962797 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 28838
I20260809 06:56:56.980537 29166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:56.963905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53602 (local address 127.10.205.66:37125)
0809 06:56:56.964488 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:56.964503 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:56.964540 (+ 37us) server_negotiation.cc:407] Connection header received
0809 06:56:56.966062 (+ 1522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:56.966071 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:56.966533 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:56.966825 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:56.968252 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:56.969583 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:56.970775 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:56.971408 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:56.971534 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:56.974294 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:56.974302 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:56.974316 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:56.974355 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:56.977472 (+ 3117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:56.978120 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:56.978126 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:56.978132 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:56.978293 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:56.978612 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:56.978615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:56.978617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:56.979128 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:56.979354 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:56.979723 (+ 369us) server_negotiation.cc:299] Negotiation successful
0809 06:56:56.980173 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":269,"threads_started":1}
I20260809 06:56:56.982002 28968 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:56:57.065593 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 28838
I20260809 06:56:57.086798 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 28976
I20260809 06:56:57.104715 29168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:57.087986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45270 (local address 127.10.205.67:37453)
0809 06:56:57.088680 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:57.088694 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:57.088738 (+ 44us) server_negotiation.cc:407] Connection header received
0809 06:56:57.090402 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:57.090413 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:57.090837 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:57.091125 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:57.092557 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:57.093769 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:57.095018 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:57.095664 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:57.095795 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:57.098515 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:57.098523 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:57.098537 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:57.098577 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:57.101553 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:57.102264 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:57.102270 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:57.102276 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:57.102443 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:57.102788 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:57.102791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:57.102793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:57.103354 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:57.103584 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:57.103943 (+ 359us) server_negotiation.cc:299] Negotiation successful
0809 06:56:57.104406 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":355,"threads_started":1}
I20260809 06:56:57.106154 29106 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:56:57.190349 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 28976
2026-08-09T06:56:57Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64892 ms)
[----------] 30 tests from SecurityITest (305993 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:56:57 dist-test-slave-0b58 krb5kdc[29172](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:56:57 dist-test-slave-0b58 krb5kdc[29172](info): set up 2 sockets
Aug 09 06:56:57 dist-test-slave-0b58 krb5kdc[29172](info): commencing operation
krb5kdc: starting...
W20260809 06:56:58.355707 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:56:58 dist-test-slave-0b58 krb5kdc[29172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:56:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:56:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:56:58.672634 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44499
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:39669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:44499
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:56:59.022436 29185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:56:59.022804 29185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:56:59.022965 29185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:56:59.030738 29185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:56:59.030900 29185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:56:59.031006 29185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:56:59.031121 29185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:56:59.031209 29185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:56:59.041451 29185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:39669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:44499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:56:59.042934 29185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:56:59.044411 29185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:56:59.057164 29194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:59.057142 29191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:59.057076 29192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:56:59.057835 29185 server_base.cc:1034] running on GCE node
I20260809 06:56:59.058705 29185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:56:59.060680 29185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:56:59.061928 29185 hybrid_clock.cc:648] HybridClock initialized: now 1786258619061886 us; error 46 us; skew 500 ppm
I20260809 06:56:59.062309 29185 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:56:59 dist-test-slave-0b58 krb5kdc[29172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258619, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:56:59.065577 29185 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:56:59.067178 29185 webserver.cc:460] Webserver started at http://127.10.205.126:34527/ using document root <none> and password file <none>
I20260809 06:56:59.067878 29185 fs_manager.cc:359] Metadata directory not provided
I20260809 06:56:59.068028 29185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:56:59.068419 29185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:56:59.071705 29185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "d800bdc4e2d941508144ada50f0cde07"
format_stamp: "Formatted at 2026-08-09 06:56:59 on dist-test-slave-0b58"
server_key: "537a8a5c19c054f6b56a12305e10f492"
server_key_iv: "fe71d925e6e2e11efca64095821ba674"
server_key_version: "encryptionkey@0"
I20260809 06:56:59.072598 29185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "d800bdc4e2d941508144ada50f0cde07"
format_stamp: "Formatted at 2026-08-09 06:56:59 on dist-test-slave-0b58"
server_key: "537a8a5c19c054f6b56a12305e10f492"
server_key_iv: "fe71d925e6e2e11efca64095821ba674"
server_key_version: "encryptionkey@0"
I20260809 06:56:59.077894 29185 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:56:59.081365 29201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:59.082654 29185 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:56:59.082837 29185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "d800bdc4e2d941508144ada50f0cde07"
format_stamp: "Formatted at 2026-08-09 06:56:59 on dist-test-slave-0b58"
server_key: "537a8a5c19c054f6b56a12305e10f492"
server_key_iv: "fe71d925e6e2e11efca64095821ba674"
server_key_version: "encryptionkey@0"
I20260809 06:56:59.083043 29185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:56:59.117595 29185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:56:59.122320 29185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:56:59.122659 29185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:56:59.141834 29185 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:44499
I20260809 06:56:59.141855 29256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:44499 every 8 connection(s)
I20260809 06:56:59.143261 29185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:56:59.145150 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 29185
I20260809 06:56:59.145394 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:56:59.146320 11061 external_mini_cluster.cc:1428] Setting key 7950a07633ea7edc9f40381a743adeb8
I20260809 06:56:59.147845 29257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:56:59.159904 29257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07: Bootstrap starting.
Aug 09 06:56:59 dist-test-slave-0b58 krb5kdc[29172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:56:59.163240 29257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07: Neither blocks nor log segments found. Creating new log.
I20260809 06:56:59.164361 29257 log.cc:824] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07: Log is configured to *not* fsync() on all Append() calls
I20260809 06:56:59.167448 29257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07: No bootstrap required, opened a new log
I20260809 06:56:59.170162 29260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:59.148541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34834 (local address 127.10.205.126:44499)
0809 06:56:59.149341 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:59.149352 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:59.149391 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:56:59.151176 (+ 1785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:59.151200 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:59.151605 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:59.152056 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:59.153769 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:59.155108 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:59.156549 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:59.157254 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:59.157495 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:59.161968 (+ 4473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:59.161975 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:59.161989 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:59.162030 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:59.165861 (+ 3831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:59.166627 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:59.166637 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:59.166644 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:59.166811 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:59.167236 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:59.167240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:59.167242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:59.167837 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:59.168150 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:59.168660 (+ 510us) server_negotiation.cc:299] Negotiation successful
0809 06:56:59.169109 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":590,"thread_start_us":360,"threads_started":1}
I20260809 06:56:59.175788 29257 raft_consensus.cc:348] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d800bdc4e2d941508144ada50f0cde07" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44499 } }
I20260809 06:56:59.176178 29257 raft_consensus.cc:374] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:56:59.176348 29257 raft_consensus.cc:729] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d800bdc4e2d941508144ada50f0cde07, State: Initialized, Role: FOLLOWER
I20260809 06:56:59.176915 29257 consensus_queue.cc:260] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d800bdc4e2d941508144ada50f0cde07" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44499 } }
I20260809 06:56:59.177145 29257 raft_consensus.cc:388] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:56:59.177276 29257 raft_consensus.cc:482] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:56:59.177449 29257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:56:59.179975 29257 raft_consensus.cc:504] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d800bdc4e2d941508144ada50f0cde07" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44499 } }
I20260809 06:56:59.180521 29257 leader_election.cc:302] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d800bdc4e2d941508144ada50f0cde07; no voters:
I20260809 06:56:59.181126 29257 leader_election.cc:288] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:56:59.181277 29262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:56:59.182037 29262 raft_consensus.cc:686] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [term 1 LEADER]: Becoming Leader. State: Replica: d800bdc4e2d941508144ada50f0cde07, State: Running, Role: LEADER
I20260809 06:56:59.182578 29262 consensus_queue.cc:237] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d800bdc4e2d941508144ada50f0cde07" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44499 } }
I20260809 06:56:59.183359 29257 sys_catalog.cc:564] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:56:59.185185 29264 sys_catalog.cc:455] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d800bdc4e2d941508144ada50f0cde07. Latest consensus state: current_term: 1 leader_uuid: "d800bdc4e2d941508144ada50f0cde07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d800bdc4e2d941508144ada50f0cde07" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44499 } } }
I20260809 06:56:59.185312 29263 sys_catalog.cc:455] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d800bdc4e2d941508144ada50f0cde07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d800bdc4e2d941508144ada50f0cde07" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44499 } } }
I20260809 06:56:59.185725 29263 sys_catalog.cc:458] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [sys.catalog]: This master's current role is: LEADER
I20260809 06:56:59.185725 29264 sys_catalog.cc:458] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07 [sys.catalog]: This master's current role is: LEADER
I20260809 06:56:59.188246 29267 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:56:59.193480 29267 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:56:59.202577 29267 catalog_manager.cc:1347] Generated new cluster ID: 4a5fec248f3d4ee78f09fa605752239d
I20260809 06:56:59.202690 29267 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:56:59.229065 29267 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:56:59.231055 29267 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:56:59.238327 29267 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07: Generated new TSK 0
I20260809 06:56:59.239495 29267 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:56:59.315876 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44499
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:39669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:56:59.657509 29283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:56:59.657817 29283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:56:59.658002 29283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:56:59.665400 29283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:56:59.665553 29283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:56:59.665746 29283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:56:59.675647 29283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:39669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:56:59.676988 29283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:56:59.678375 29283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:56:59.691732 29291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:59.691856 29289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:56:59.691918 29288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:56:59.692960 29283 server_base.cc:1034] running on GCE node
I20260809 06:56:59.693617 29283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:56:59.694583 29283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:56:59.695782 29283 hybrid_clock.cc:648] HybridClock initialized: now 1786258619695727 us; error 43 us; skew 500 ppm
I20260809 06:56:59.696095 29283 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:56:59 dist-test-slave-0b58 krb5kdc[29172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258619, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:56:59.699343 29283 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:56:59.700824 29283 webserver.cc:460] Webserver started at http://127.10.205.65:38347/ using document root <none> and password file <none>
I20260809 06:56:59.701504 29283 fs_manager.cc:359] Metadata directory not provided
I20260809 06:56:59.701645 29283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:56:59.701987 29283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:56:59.705014 29283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "71089123eaf44262b1f244901eb631d5"
format_stamp: "Formatted at 2026-08-09 06:56:59 on dist-test-slave-0b58"
server_key: "3df31184e0a9955e407c7a03610b69bf"
server_key_iv: "b4ed919f501bbb44e495aa3b2b5dec84"
server_key_version: "encryptionkey@0"
I20260809 06:56:59.705855 29283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "71089123eaf44262b1f244901eb631d5"
format_stamp: "Formatted at 2026-08-09 06:56:59 on dist-test-slave-0b58"
server_key: "3df31184e0a9955e407c7a03610b69bf"
server_key_iv: "b4ed919f501bbb44e495aa3b2b5dec84"
server_key_version: "encryptionkey@0"
I20260809 06:56:59.711112 29283 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:56:59.714573 29299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:59.715821 29283 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 06:56:59.715978 29283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "71089123eaf44262b1f244901eb631d5"
format_stamp: "Formatted at 2026-08-09 06:56:59 on dist-test-slave-0b58"
server_key: "3df31184e0a9955e407c7a03610b69bf"
server_key_iv: "b4ed919f501bbb44e495aa3b2b5dec84"
server_key_version: "encryptionkey@0"
I20260809 06:56:59.716189 29283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:56:59.735780 29283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:56:59.740119 29283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:56:59.740460 29283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:56:59.741487 29283 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:56:59.742858 29283 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:56:59.742933 29283 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:59.743104 29283 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:56:59.743162 29283 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:56:59.778167 29283 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:33629
I20260809 06:56:59.778211 29420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:33629 every 8 connection(s)
I20260809 06:56:59.779544 29283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:56:59.787161 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 29283
I20260809 06:56:59.787403 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:56:59.788125 11061 external_mini_cluster.cc:1428] Setting key 17d93baeca83bf746a5650294b214395
Aug 09 06:56:59 dist-test-slave-0b58 krb5kdc[29172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258619, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:56:59.799402 29423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:59.782061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:44487 (local address 127.10.205.126:44499)
0809 06:56:59.782518 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0809 06:56:59.782522 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:56:59.783367 (+ 845us) server_negotiation.cc:407] Connection header received
0809 06:56:59.785302 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:56:59.785307 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:56:59.785407 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:56:59.785520 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:56:59.787136 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:59.788067 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:59.789843 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:56:59.790379 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:56:59.790517 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:59.793854 (+ 3337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:56:59.793859 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:56:59.793862 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:56:59.793892 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:56:59.796496 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:59.797191 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:59.797196 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:59.797198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:59.797315 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:56:59.797725 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:56:59.797729 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:56:59.797737 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:56:59.797995 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:56:59.798145 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 06:56:59.798813 (+ 668us) server_negotiation.cc:299] Negotiation successful
0809 06:56:59.799031 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":245,"threads_started":1}
I20260809 06:56:59.800393 29424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:56:59.782472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44499 (local address 127.10.205.65:44487)
0809 06:56:59.783212 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0809 06:56:59.783256 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 06:56:59.785043 (+ 1787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:56:59.785758 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:56:59.785766 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:56:59.786285 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:56:59.786945 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:59.786965 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:59.788221 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:59.788225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:59.789697 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:56:59.789710 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:56:59.790610 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:56:59.790618 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:56:59.790871 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:56:59.791517 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:56:59.791543 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:56:59.793631 (+ 2088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:56:59.796629 (+ 2998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:56:59.796637 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:56:59.796652 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:56:59.797068 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:56:59.797419 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:56:59.797424 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:56:59.797428 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:56:59.797612 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:56:59.798120 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:56:59.798127 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:56:59.798444 (+ 317us) client_negotiation.cc:769] Sending connection context
0809 06:56:59.798685 (+ 241us) client_negotiation.cc:240] Negotiation successful
0809 06:56:59.799208 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":272,"threads_started":1}
I20260809 06:56:59.802038 29421 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44499
I20260809 06:56:59.802357 29421 heartbeater.cc:464] Registering TS with master...
I20260809 06:56:59.803206 29421 heartbeater.cc:511] Master 127.10.205.126:44499 requested a full tablet report, sending...
I20260809 06:56:59.805274 29220 ts_manager.cc:194] Registered new tserver with Master: 71089123eaf44262b1f244901eb631d5 (127.10.205.65:33629)
I20260809 06:56:59.806722 29220 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:44487
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:56:59.855647 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44499
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:39669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:00.192312 29427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:00.192620 29427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:00.192791 29427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:00.199905 29427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:00.200021 29427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:00.200225 29427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:57:00.210122 29427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:39669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:00.211400 29427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:00.212829 29427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:00.226420 29433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:00.226655 29432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:00.226462 29435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:00.228597 29427 server_base.cc:1034] running on GCE node
I20260809 06:57:00.229385 29427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:00.230665 29427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:00.231887 29427 hybrid_clock.cc:648] HybridClock initialized: now 1786258620231785 us; error 89 us; skew 500 ppm
I20260809 06:57:00.232203 29427 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:00 dist-test-slave-0b58 krb5kdc[29172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258620, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:00.235536 29427 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:57:00.237056 29427 webserver.cc:460] Webserver started at http://127.10.205.66:34129/ using document root <none> and password file <none>
I20260809 06:57:00.237798 29427 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:00.237937 29427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:00.238243 29427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:00.241231 29427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "9d71837919bb4b0eb180e93b59985acc"
format_stamp: "Formatted at 2026-08-09 06:57:00 on dist-test-slave-0b58"
server_key: "d358b7fde1d5de3aaf878bb9856b7f55"
server_key_iv: "2605cdce55f517e4aba02f22b173f4fc"
server_key_version: "encryptionkey@0"
I20260809 06:57:00.242044 29427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "9d71837919bb4b0eb180e93b59985acc"
format_stamp: "Formatted at 2026-08-09 06:57:00 on dist-test-slave-0b58"
server_key: "d358b7fde1d5de3aaf878bb9856b7f55"
server_key_iv: "2605cdce55f517e4aba02f22b173f4fc"
server_key_version: "encryptionkey@0"
I20260809 06:57:00.247205 29427 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:57:00.250720 29443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:00.251968 29427 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 06:57:00.252137 29427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "9d71837919bb4b0eb180e93b59985acc"
format_stamp: "Formatted at 2026-08-09 06:57:00 on dist-test-slave-0b58"
server_key: "d358b7fde1d5de3aaf878bb9856b7f55"
server_key_iv: "2605cdce55f517e4aba02f22b173f4fc"
server_key_version: "encryptionkey@0"
I20260809 06:57:00.252375 29427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:00.274948 29427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:00.278879 29427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:00.279191 29427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:00.280176 29427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:00.281574 29427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:00.281672 29427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:00.281826 29427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:00.281908 29427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:00.315224 29427 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:37907
I20260809 06:57:00.315310 29562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:37907 every 8 connection(s)
I20260809 06:57:00.316624 29427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:57:00.326327 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 29427
I20260809 06:57:00.326540 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:57:00.327142 11061 external_mini_cluster.cc:1428] Setting key f9729dd7cbfff41085ada193af41557f
Aug 09 06:57:00 dist-test-slave-0b58 krb5kdc[29172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258620, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:00.339365 29565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:00.319207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:38017 (local address 127.10.205.126:44499)
0809 06:57:00.319666 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:00.319674 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:00.320795 (+ 1121us) server_negotiation.cc:407] Connection header received
0809 06:57:00.322681 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:00.322685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:00.322751 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:00.322837 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:00.324313 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.325025 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.327039 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.327527 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.327627 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:00.331831 (+ 4204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:00.331840 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:00.331848 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:00.331899 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:00.335663 (+ 3764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:00.336486 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:00.336493 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:00.336499 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:00.336671 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:00.337097 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:00.337104 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:00.337109 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:00.337544 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:00.337711 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:00.338592 (+ 881us) server_negotiation.cc:299] Negotiation successful
0809 06:57:00.338856 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":202,"threads_started":1}
I20260809 06:57:00.340302 29566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:00.319774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44499 (local address 127.10.205.66:38017)
0809 06:57:00.320627 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:00.320677 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:00.322378 (+ 1701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:00.323020 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:00.323028 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:00.323535 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:00.324110 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:00.324127 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.325173 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.325176 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:00.326900 (+ 1724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:00.326914 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.327779 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.327785 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:00.328035 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:00.328850 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:57:00.328887 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:00.331572 (+ 2685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:00.335835 (+ 4263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:00.335843 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:00.335857 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:00.336368 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:00.336784 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:00.336787 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:00.336789 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:00.336971 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:00.337691 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:00.337702 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:00.338146 (+ 444us) client_negotiation.cc:769] Sending connection context
0809 06:57:00.338434 (+ 288us) client_negotiation.cc:240] Negotiation successful
0809 06:57:00.338980 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":361,"threads_started":1}
I20260809 06:57:00.341894 29563 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44499
I20260809 06:57:00.342249 29563 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:00.343164 29563 heartbeater.cc:511] Master 127.10.205.126:44499 requested a full tablet report, sending...
I20260809 06:57:00.344841 29220 ts_manager.cc:194] Registered new tserver with Master: 9d71837919bb4b0eb180e93b59985acc (127.10.205.66:37907)
I20260809 06:57:00.345715 29220 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:38017
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:57:00.397399 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44499
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:39669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:00.736362 29569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:00.736665 29569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:00.736862 29569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:00.744038 29569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:00.744149 29569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:00.744349 29569 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:57:00.754016 29569 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:39669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:00.755364 29569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:00.756806 29569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:00.770141 29576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:00.770195 29578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:00.770221 29574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:00.771344 29569 server_base.cc:1034] running on GCE node
I20260809 06:57:00.771982 29569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:00.772926 29569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:00.774153 29569 hybrid_clock.cc:648] HybridClock initialized: now 1786258620774112 us; error 48 us; skew 500 ppm
I20260809 06:57:00.774448 29569 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:00 dist-test-slave-0b58 krb5kdc[29172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258620, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:00.777818 29569 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:57:00.782975 29569 webserver.cc:460] Webserver started at http://127.10.205.67:32897/ using document root <none> and password file <none>
I20260809 06:57:00.783705 29569 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:00.783838 29569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:00.784178 29569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:00.787215 29569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "0828c7385ac0491ba762fc460e0e3dd8"
format_stamp: "Formatted at 2026-08-09 06:57:00 on dist-test-slave-0b58"
server_key: "6515cfde1a93deeaf7bbfb72a7fa4222"
server_key_iv: "29e344fbc33183121e0ded3ee2d5557f"
server_key_version: "encryptionkey@0"
I20260809 06:57:00.788084 29569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "0828c7385ac0491ba762fc460e0e3dd8"
format_stamp: "Formatted at 2026-08-09 06:57:00 on dist-test-slave-0b58"
server_key: "6515cfde1a93deeaf7bbfb72a7fa4222"
server_key_iv: "29e344fbc33183121e0ded3ee2d5557f"
server_key_version: "encryptionkey@0"
I20260809 06:57:00.793298 29569 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260809 06:57:00.796644 29585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:00.797857 29569 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 06:57:00.798020 29569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "0828c7385ac0491ba762fc460e0e3dd8"
format_stamp: "Formatted at 2026-08-09 06:57:00 on dist-test-slave-0b58"
server_key: "6515cfde1a93deeaf7bbfb72a7fa4222"
server_key_iv: "29e344fbc33183121e0ded3ee2d5557f"
server_key_version: "encryptionkey@0"
I20260809 06:57:00.798198 29569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:00.809600 29421 heartbeater.cc:503] Master 127.10.205.126:44499 was elected leader, sending a full tablet report...
I20260809 06:57:00.813513 29569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:00.817799 29569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:00.818087 29569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:00.819065 29569 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:00.820492 29569 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:00.820575 29569 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:00.820721 29569 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:00.820785 29569 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:00.851817 29569 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:36773
I20260809 06:57:00.851835 29704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:36773 every 8 connection(s)
I20260809 06:57:00.853240 29569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:57:00.858458 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 29569
I20260809 06:57:00.858654 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:57:00.859125 11061 external_mini_cluster.cc:1428] Setting key 4f3fe5f430b9f4c0dd91d1588dd06808
Aug 09 06:57:00 dist-test-slave-0b58 krb5kdc[29172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258620, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:00.873006 29707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:00.855787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:36573 (local address 127.10.205.126:44499)
0809 06:57:00.856348 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:00.856352 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:00.857378 (+ 1026us) server_negotiation.cc:407] Connection header received
0809 06:57:00.859271 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:00.859277 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:00.859379 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:00.859498 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:00.861167 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.861995 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.863558 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.863979 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.864110 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:00.867502 (+ 3392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:00.867508 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:00.867511 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:00.867544 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:00.870008 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:00.870725 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:00.870730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:00.870732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:00.870847 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:00.871274 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:00.871278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:00.871280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:00.871540 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:00.871721 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:00.872398 (+ 677us) server_negotiation.cc:299] Negotiation successful
0809 06:57:00.872619 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":235,"threads_started":1}
I20260809 06:57:00.873926 29708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:00.856430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44499 (local address 127.10.205.67:36573)
0809 06:57:00.857204 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:00.857241 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:00.859004 (+ 1763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:00.859745 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:00.859753 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:00.860434 (+ 681us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:00.861001 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:00.861018 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.862166 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.862170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:00.863416 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:00.863428 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.864201 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.864210 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:00.864492 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:00.865082 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:57:00.865103 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:00.867291 (+ 2188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:00.870148 (+ 2857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:00.870156 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:00.870172 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:00.870597 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:00.870954 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:00.870959 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:00.870962 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:00.871145 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:00.871667 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:00.871676 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:00.872012 (+ 336us) client_negotiation.cc:769] Sending connection context
0809 06:57:00.872258 (+ 246us) client_negotiation.cc:240] Negotiation successful
0809 06:57:00.872806 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":292,"threads_started":1}
I20260809 06:57:00.875340 29705 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44499
I20260809 06:57:00.875626 29705 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:00.876364 29705 heartbeater.cc:511] Master 127.10.205.126:44499 requested a full tablet report, sending...
I20260809 06:57:00.877674 29220 ts_manager.cc:194] Registered new tserver with Master: 0828c7385ac0491ba762fc460e0e3dd8 (127.10.205.67:36773)
I20260809 06:57:00.878491 29220 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:36573
I20260809 06:57:00.886907 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:57:00.905673 29707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:00.891805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44398 (local address 127.10.205.126:44499)
0809 06:57:00.891970 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:00.891989 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:00.892492 (+ 503us) server_negotiation.cc:407] Connection header received
0809 06:57:00.892696 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:00.892706 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:00.892789 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:00.892890 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:00.894935 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.895700 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.897071 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.897475 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.897621 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:00.900102 (+ 2481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:00.900108 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:00.900117 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:00.900150 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:00.902954 (+ 2804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:00.903634 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:00.903640 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:00.903644 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:00.903776 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:00.904152 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:00.904160 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:00.904163 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:00.904538 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:00.904822 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:00.905145 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 06:57:00.905367 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:57:00.909584 29220 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44398:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:57:00.917184 29220 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:57:00.941700 29720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:00.929868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37216 (local address 127.10.205.67:36773)
0809 06:57:00.932103 (+ 2235us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:00.932112 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:00.932150 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:57:00.932306 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:00.932313 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:00.932870 (+ 557us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:00.933830 (+ 960us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:00.934105 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.935800 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.938853 (+ 3053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.940413 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.940551 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:00.940814 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:00.941148 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 06:57:00.941320 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2081,"thread_start_us":1933,"threads_started":1}
I20260809 06:57:00.941804 29721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:00.929626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:36773 (local address 127.0.0.1:37216)
0809 06:57:00.931158 (+ 1532us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:00.931218 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:00.931451 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:00.933123 (+ 1672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:00.933131 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:00.933167 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:00.933620 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:00.933634 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.935955 (+ 2321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.935961 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:00.938694 (+ 2733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:00.938712 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.940620 (+ 1908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.940626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:00.940843 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:00.940914 (+ 71us) client_negotiation.cc:769] Sending connection context
0809 06:57:00.941076 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 06:57:00.941355 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1207,"mutex_wait_us":20,"thread_start_us":3082,"threads_started":1}
I20260809 06:57:00.941964 29722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:00.930812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59612 (local address 127.10.205.66:37907)
0809 06:57:00.932519 (+ 1707us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:00.932527 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:00.933112 (+ 585us) server_negotiation.cc:407] Connection header received
0809 06:57:00.933414 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:00.933424 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:00.933647 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:00.933825 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:00.934845 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.936339 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.939201 (+ 2862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.940627 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.940772 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:00.940981 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:00.941464 (+ 483us) server_negotiation.cc:299] Negotiation successful
0809 06:57:00.941636 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1548,"thread_start_us":1450,"threads_started":1}
I20260809 06:57:00.942873 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:00.930187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:37907 (local address 127.0.0.1:59612)
0809 06:57:00.933009 (+ 2822us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:00.933028 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:00.933204 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:00.934106 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:00.934110 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:00.934136 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:00.934633 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:00.934646 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.936513 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.936524 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:00.939007 (+ 2483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:00.939019 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.940981 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.940989 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:00.941225 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:00.941287 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 06:57:00.942276 (+ 989us) client_negotiation.cc:240] Negotiation successful
0809 06:57:00.942430 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2687,"mutex_wait_us":3,"thread_start_us":776,"threads_started":1}
I20260809 06:57:00.946480 29496 tablet_service.cc:1467] Processing CreateTablet for tablet ed0543431ccc453fb404188aa5ab867c (DEFAULT_TABLE table=test-table [id=ddf67b505d344170af8b098d24fa3384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:00.946394 29637 tablet_service.cc:1467] Processing CreateTablet for tablet ed0543431ccc453fb404188aa5ab867c (DEFAULT_TABLE table=test-table [id=ddf67b505d344170af8b098d24fa3384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:00.947950 29496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed0543431ccc453fb404188aa5ab867c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:00.947950 29637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed0543431ccc453fb404188aa5ab867c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:00.948748 29724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:00.933783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:33629 (local address 127.0.0.1:60146)
0809 06:57:00.939463 (+ 5680us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:00.939478 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:00.939569 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:00.942565 (+ 2996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:00.942570 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:00.942596 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:00.943010 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:00.943022 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.944682 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.944690 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:00.946139 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:00.946152 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.947913 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.947920 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:00.948087 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:00.948128 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 06:57:00.948240 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 06:57:00.948418 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5575,"thread_start_us":5416,"threads_started":1}
I20260809 06:57:00.948873 29723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:00.933453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60146 (local address 127.10.205.65:33629)
0809 06:57:00.941866 (+ 8413us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:00.941890 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:00.941926 (+ 36us) server_negotiation.cc:407] Connection header received
0809 06:57:00.942034 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:00.942043 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:00.942340 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:00.942561 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:00.943210 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.944543 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.946330 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:00.947706 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:00.947865 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:00.948092 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:00.948364 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 06:57:00.948527 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6979,"thread_start_us":5307,"threads_started":1}
I20260809 06:57:00.951891 29352 tablet_service.cc:1467] Processing CreateTablet for tablet ed0543431ccc453fb404188aa5ab867c (DEFAULT_TABLE table=test-table [id=ddf67b505d344170af8b098d24fa3384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:00.953303 29352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed0543431ccc453fb404188aa5ab867c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:00.963147 29726 tablet_bootstrap.cc:492] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8: Bootstrap starting.
I20260809 06:57:00.965049 29725 tablet_bootstrap.cc:492] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc: Bootstrap starting.
I20260809 06:57:00.965355 29727 tablet_bootstrap.cc:492] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5: Bootstrap starting.
I20260809 06:57:00.968323 29726 tablet_bootstrap.cc:654] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:00.968184 29725 tablet_bootstrap.cc:654] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:00.968881 29727 tablet_bootstrap.cc:654] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:00.969695 29726 log.cc:824] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:00.969729 29725 log.cc:824] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:00.970158 29727 log.cc:824] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:00.972761 29725 tablet_bootstrap.cc:492] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc: No bootstrap required, opened a new log
I20260809 06:57:00.972999 29726 tablet_bootstrap.cc:492] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8: No bootstrap required, opened a new log
I20260809 06:57:00.973030 29725 ts_tablet_manager.cc:1397] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 06:57:00.973199 29727 tablet_bootstrap.cc:492] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5: No bootstrap required, opened a new log
I20260809 06:57:00.973263 29726 ts_tablet_manager.cc:1397] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260809 06:57:00.973462 29727 ts_tablet_manager.cc:1397] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.001s
I20260809 06:57:00.980592 29725 raft_consensus.cc:348] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0828c7385ac0491ba762fc460e0e3dd8" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36773 } } peers { permanent_uuid: "71089123eaf44262b1f244901eb631d5" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33629 } } peers { permanent_uuid: "9d71837919bb4b0eb180e93b59985acc" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37907 } }
I20260809 06:57:00.980983 29725 raft_consensus.cc:374] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:00.981086 29725 raft_consensus.cc:729] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d71837919bb4b0eb180e93b59985acc, State: Initialized, Role: FOLLOWER
I20260809 06:57:00.981745 29725 consensus_queue.cc:260] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0828c7385ac0491ba762fc460e0e3dd8" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36773 } } peers { permanent_uuid: "71089123eaf44262b1f244901eb631d5" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33629 } } peers { permanent_uuid: "9d71837919bb4b0eb180e93b59985acc" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37907 } }
I20260809 06:57:00.982890 29563 heartbeater.cc:503] Master 127.10.205.126:44499 was elected leader, sending a full tablet report...
I20260809 06:57:00.983507 29725 ts_tablet_manager.cc:1428] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc: Time spent starting tablet: real 0.010s user 0.000s sys 0.009s
I20260809 06:57:00.984171 29726 raft_consensus.cc:348] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0828c7385ac0491ba762fc460e0e3dd8" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36773 } } peers { permanent_uuid: "71089123eaf44262b1f244901eb631d5" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33629 } } peers { permanent_uuid: "9d71837919bb4b0eb180e93b59985acc" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37907 } }
I20260809 06:57:00.984714 29726 raft_consensus.cc:374] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:00.984860 29726 raft_consensus.cc:729] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0828c7385ac0491ba762fc460e0e3dd8, State: Initialized, Role: FOLLOWER
I20260809 06:57:00.984917 29727 raft_consensus.cc:348] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0828c7385ac0491ba762fc460e0e3dd8" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36773 } } peers { permanent_uuid: "71089123eaf44262b1f244901eb631d5" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33629 } } peers { permanent_uuid: "9d71837919bb4b0eb180e93b59985acc" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37907 } }
I20260809 06:57:00.985343 29727 raft_consensus.cc:374] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:00.985461 29727 raft_consensus.cc:729] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71089123eaf44262b1f244901eb631d5, State: Initialized, Role: FOLLOWER
I20260809 06:57:00.985457 29726 consensus_queue.cc:260] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0828c7385ac0491ba762fc460e0e3dd8" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36773 } } peers { permanent_uuid: "71089123eaf44262b1f244901eb631d5" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33629 } } peers { permanent_uuid: "9d71837919bb4b0eb180e93b59985acc" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37907 } }
I20260809 06:57:00.986053 29727 consensus_queue.cc:260] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0828c7385ac0491ba762fc460e0e3dd8" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36773 } } peers { permanent_uuid: "71089123eaf44262b1f244901eb631d5" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33629 } } peers { permanent_uuid: "9d71837919bb4b0eb180e93b59985acc" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37907 } }
I20260809 06:57:00.986670 29705 heartbeater.cc:503] Master 127.10.205.126:44499 was elected leader, sending a full tablet report...
I20260809 06:57:00.987474 29726 ts_tablet_manager.cc:1428] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260809 06:57:00.990912 29727 ts_tablet_manager.cc:1428] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
I20260809 06:57:01.020732 29733 raft_consensus.cc:482] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:57:01.021066 29733 raft_consensus.cc:504] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0828c7385ac0491ba762fc460e0e3dd8" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36773 } } peers { permanent_uuid: "71089123eaf44262b1f244901eb631d5" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33629 } } peers { permanent_uuid: "9d71837919bb4b0eb180e93b59985acc" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37907 } }
I20260809 06:57:01.022737 29733 leader_election.cc:288] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0828c7385ac0491ba762fc460e0e3dd8 (127.10.205.67:36773), 9d71837919bb4b0eb180e93b59985acc (127.10.205.66:37907)
W20260809 06:57:01.032029 29422 tablet.cc:2369] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:57:01.032470 29720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:01.023161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:36287 (local address 127.10.205.67:36773)
0809 06:57:01.023367 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:01.023373 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:01.024286 (+ 913us) server_negotiation.cc:407] Connection header received
0809 06:57:01.024449 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:01.024454 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:01.024530 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:01.024629 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:01.025409 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.026539 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.029881 (+ 3342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.031140 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.031316 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:01.031392 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:01.032046 (+ 654us) server_negotiation.cc:299] Negotiation successful
0809 06:57:01.032172 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 06:57:01.032480 29722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:01.023330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:47415 (local address 127.10.205.66:37907)
0809 06:57:01.023546 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:01.023554 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:01.024196 (+ 642us) server_negotiation.cc:407] Connection header received
0809 06:57:01.024444 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:01.024449 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:01.024530 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:01.024629 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:01.025408 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.026540 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.029876 (+ 3336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.031140 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.031316 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:01.031392 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:01.032036 (+ 644us) server_negotiation.cc:299] Negotiation successful
0809 06:57:01.032182 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:57:01.032706 29734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:01.023145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:37907 (local address 127.10.205.65:47415)
0809 06:57:01.024051 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:01.024073 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:01.024283 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:01.024657 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:01.024662 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:01.024760 (+ 98us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:01.025257 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:01.025266 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.026674 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.026678 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:01.029664 (+ 2986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:01.029681 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.031418 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.031426 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:01.031711 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:01.031875 (+ 164us) client_negotiation.cc:769] Sending connection context
0809 06:57:01.031982 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 06:57:01.032125 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"mutex_wait_us":400,"spinlock_wait_cycles":22784,"thread_start_us":404,"threads_started":1}
I20260809 06:57:01.033128 29735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:01.023214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:36773 (local address 127.10.205.65:36287)
0809 06:57:01.024156 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:01.024177 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:01.024303 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:01.024657 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:01.024662 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:01.024689 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:01.025231 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:01.025262 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.026672 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.026678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:01.029666 (+ 2988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:01.029681 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.031434 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.031439 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:01.031708 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:01.031875 (+ 167us) client_negotiation.cc:769] Sending connection context
0809 06:57:01.032657 (+ 782us) client_negotiation.cc:240] Negotiation successful
0809 06:57:01.032800 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":826,"mutex_wait_us":379,"thread_start_us":605,"threads_started":1}
I20260809 06:57:01.033964 29516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0543431ccc453fb404188aa5ab867c" candidate_uuid: "71089123eaf44262b1f244901eb631d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d71837919bb4b0eb180e93b59985acc" is_pre_election: true
I20260809 06:57:01.034103 29657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0543431ccc453fb404188aa5ab867c" candidate_uuid: "71089123eaf44262b1f244901eb631d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0828c7385ac0491ba762fc460e0e3dd8" is_pre_election: true
I20260809 06:57:01.034673 29516 raft_consensus.cc:2454] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71089123eaf44262b1f244901eb631d5 in term 0.
I20260809 06:57:01.034672 29657 raft_consensus.cc:2454] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71089123eaf44262b1f244901eb631d5 in term 0.
I20260809 06:57:01.035364 29302 leader_election.cc:302] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71089123eaf44262b1f244901eb631d5, 9d71837919bb4b0eb180e93b59985acc; no voters:
I20260809 06:57:01.035727 29733 raft_consensus.cc:2781] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:57:01.035883 29733 raft_consensus.cc:482] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:57:01.036031 29733 raft_consensus.cc:3037] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:01.038486 29733 raft_consensus.cc:504] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0828c7385ac0491ba762fc460e0e3dd8" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36773 } } peers { permanent_uuid: "71089123eaf44262b1f244901eb631d5" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33629 } } peers { permanent_uuid: "9d71837919bb4b0eb180e93b59985acc" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37907 } }
I20260809 06:57:01.039083 29733 leader_election.cc:288] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [CANDIDATE]: Term 1 election: Requested vote from peers 0828c7385ac0491ba762fc460e0e3dd8 (127.10.205.67:36773), 9d71837919bb4b0eb180e93b59985acc (127.10.205.66:37907)
I20260809 06:57:01.039585 29516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0543431ccc453fb404188aa5ab867c" candidate_uuid: "71089123eaf44262b1f244901eb631d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d71837919bb4b0eb180e93b59985acc"
I20260809 06:57:01.039592 29657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed0543431ccc453fb404188aa5ab867c" candidate_uuid: "71089123eaf44262b1f244901eb631d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0828c7385ac0491ba762fc460e0e3dd8"
I20260809 06:57:01.039794 29516 raft_consensus.cc:3037] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:01.039804 29657 raft_consensus.cc:3037] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:01.042091 29657 raft_consensus.cc:2454] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71089123eaf44262b1f244901eb631d5 in term 1.
I20260809 06:57:01.042092 29516 raft_consensus.cc:2454] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71089123eaf44262b1f244901eb631d5 in term 1.
I20260809 06:57:01.042536 29300 leader_election.cc:302] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0828c7385ac0491ba762fc460e0e3dd8, 71089123eaf44262b1f244901eb631d5; no voters:
I20260809 06:57:01.042845 29733 raft_consensus.cc:2781] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:01.043354 29733 raft_consensus.cc:686] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 1 LEADER]: Becoming Leader. State: Replica: 71089123eaf44262b1f244901eb631d5, State: Running, Role: LEADER
I20260809 06:57:01.043826 29733 consensus_queue.cc:237] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0828c7385ac0491ba762fc460e0e3dd8" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36773 } } peers { permanent_uuid: "71089123eaf44262b1f244901eb631d5" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33629 } } peers { permanent_uuid: "9d71837919bb4b0eb180e93b59985acc" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37907 } }
I20260809 06:57:01.048635 29219 catalog_manager.cc:5495] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71089123eaf44262b1f244901eb631d5 (127.10.205.65). New cstate: current_term: 1 leader_uuid: "71089123eaf44262b1f244901eb631d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0828c7385ac0491ba762fc460e0e3dd8" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71089123eaf44262b1f244901eb631d5" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 33629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d71837919bb4b0eb180e93b59985acc" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37907 } health_report { overall_health: UNKNOWN } } }
I20260809 06:57:01.063791 29723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:01.058830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60158 (local address 127.10.205.65:33629)
0809 06:57:01.059000 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:01.059004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:01.059023 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:57:01.059208 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:01.059212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:01.059288 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:01.059410 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:57:01.059729 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.060531 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.061936 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.062310 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.062398 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:01.062860 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:57:01.063345 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:57:01.063457 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:01.063523 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 06:57:01.063585 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 06:57:01.068866 29564 tablet.cc:2369] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:57:01.071740 29516 raft_consensus.cc:1261] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc [term 1 FOLLOWER]: Refusing update from remote peer 71089123eaf44262b1f244901eb631d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:57:01.071779 29657 raft_consensus.cc:1261] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8 [term 1 FOLLOWER]: Refusing update from remote peer 71089123eaf44262b1f244901eb631d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:57:01.072731 29736 consensus_queue.cc:1035] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0828c7385ac0491ba762fc460e0e3dd8" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:57:01.073087 29733 consensus_queue.cc:1035] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d71837919bb4b0eb180e93b59985acc" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:57:01.084431 29739 mvcc.cc:205] Tried to move back new op lower bound from 7316515311900422144 to 7316515311799185408. Current Snapshot: MvccSnapshot[applied={T|T < 7316515311900422144}]
I20260809 06:57:01.086910 29743 mvcc.cc:205] Tried to move back new op lower bound from 7316515311900422144 to 7316515311799185408. Current Snapshot: MvccSnapshot[applied={T|T < 7316515311900422144}]
I20260809 06:57:01.097743 29219 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:57:01.098004 29219 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:57:01.101624 29219 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d800bdc4e2d941508144ada50f0cde07: Sending DeleteTablet for 3 replicas of tablet ed0543431ccc453fb404188aa5ab867c
I20260809 06:57:01.102710 29637 tablet_service.cc:1514] Processing DeleteTablet for tablet ed0543431ccc453fb404188aa5ab867c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:01 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:37216
I20260809 06:57:01.102876 29352 tablet_service.cc:1514] Processing DeleteTablet for tablet ed0543431ccc453fb404188aa5ab867c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:01 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:60146
I20260809 06:57:01.103498 29496 tablet_service.cc:1514] Processing DeleteTablet for tablet ed0543431ccc453fb404188aa5ab867c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:01 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:59612
I20260809 06:57:01.104123 29751 tablet_replica.cc:330] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8: stopping tablet replica
I20260809 06:57:01.104628 29751 raft_consensus.cc:2229] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:57:01.104820 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 29283
I20260809 06:57:01.105192 29751 raft_consensus.cc:2258] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:01.105957 29752 tablet_replica.cc:330] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5: stopping tablet replica
I20260809 06:57:01.106276 29753 tablet_replica.cc:330] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc: stopping tablet replica
I20260809 06:57:01.106364 29752 raft_consensus.cc:2229] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:57:01.106663 29753 raft_consensus.cc:2229] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:57:01.106986 29752 raft_consensus.cc:2258] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:01.107110 29753 raft_consensus.cc:2258] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:01.109412 29753 ts_tablet_manager.cc:1905] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:01.109412 29751 ts_tablet_manager.cc:1905] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:01.109427 29752 ts_tablet_manager.cc:1905] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:01.116473 29753 ts_tablet_manager.cc:1918] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:01.116725 29753 log.cc:1196] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/ed0543431ccc453fb404188aa5ab867c
I20260809 06:57:01.117035 29752 ts_tablet_manager.cc:1918] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:01.117296 29752 log.cc:1196] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/ed0543431ccc453fb404188aa5ab867c
I20260809 06:57:01.117502 29753 ts_tablet_manager.cc:1939] T ed0543431ccc453fb404188aa5ab867c P 9d71837919bb4b0eb180e93b59985acc: Deleting consensus metadata
Aug 09 06:57:01 dist-test-slave-0b58 krb5kdc[29172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:57:01.117972 29752 ts_tablet_manager.cc:1939] T ed0543431ccc453fb404188aa5ab867c P 71089123eaf44262b1f244901eb631d5: Deleting consensus metadata
I20260809 06:57:01.119715 29203 catalog_manager.cc:4841] TS 9d71837919bb4b0eb180e93b59985acc (127.10.205.66:37907): tablet ed0543431ccc453fb404188aa5ab867c (table test-table [id=ddf67b505d344170af8b098d24fa3384]) successfully deleted
I20260809 06:57:01.119931 29202 catalog_manager.cc:4841] TS 71089123eaf44262b1f244901eb631d5 (127.10.205.65:33629): tablet ed0543431ccc453fb404188aa5ab867c (table test-table [id=ddf67b505d344170af8b098d24fa3384]) successfully deleted
I20260809 06:57:01.124202 29751 ts_tablet_manager.cc:1918] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:01.124431 29751 log.cc:1196] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/ed0543431ccc453fb404188aa5ab867c
I20260809 06:57:01.125052 29751 ts_tablet_manager.cc:1939] T ed0543431ccc453fb404188aa5ab867c P 0828c7385ac0491ba762fc460e0e3dd8: Deleting consensus metadata
I20260809 06:57:01.126050 29723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:01.106265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60172 (local address 127.10.205.65:33629)
0809 06:57:01.106436 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:01.106442 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:01.106916 (+ 474us) server_negotiation.cc:407] Connection header received
0809 06:57:01.107197 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:01.107202 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:01.107286 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:01.107376 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:01.109476 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.110571 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.112489 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.113209 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.113310 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:01.119240 (+ 5930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:01.119252 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:01.119284 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:01.119340 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:01.122818 (+ 3478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:01.123552 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:01.123559 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:01.123561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:01.123710 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:01.124137 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:01.124141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:01.124143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:01.124680 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:01.125000 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:01.125392 (+ 392us) server_negotiation.cc:299] Negotiation successful
0809 06:57:01.125647 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:57:01.126825 29415 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:01.126914 29202 catalog_manager.cc:4841] TS 0828c7385ac0491ba762fc460e0e3dd8 (127.10.205.67:36773): tablet ed0543431ccc453fb404188aa5ab867c (table test-table [id=ddf67b505d344170af8b098d24fa3384]) successfully deleted
I20260809 06:57:01.237637 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 29283
I20260809 06:57:01.258952 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 29427
Aug 09 06:57:01 dist-test-slave-0b58 krb5kdc[29172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:57:01.274458 29722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:01.259769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59628 (local address 127.10.205.66:37907)
0809 06:57:01.259973 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:01.259979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:01.260000 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:57:01.260143 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:01.260147 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:01.260210 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:01.260392 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:01.261819 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.262572 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.263873 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.264348 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.264470 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:01.268832 (+ 4362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:01.268849 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:01.268865 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:01.268902 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:01.271629 (+ 2727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:01.272329 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:01.272344 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:01.272346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:01.272471 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:01.272848 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:01.272853 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:01.272856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:01.273241 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:01.273548 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:01.273869 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 06:57:01.274089 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 06:57:01.275182 29558 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:01.369577 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 29427
I20260809 06:57:01.391630 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 29569
Aug 09 06:57:01 dist-test-slave-0b58 krb5kdc[29172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:57:01.407155 29720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:01.392488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37232 (local address 127.10.205.67:36773)
0809 06:57:01.392662 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:01.392667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:01.392688 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:57:01.392797 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:01.392801 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:01.392878 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:01.392968 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:01.394256 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.394988 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.396244 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:01.396778 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:01.396872 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:01.401498 (+ 4626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:01.401516 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:01.401533 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:01.401568 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:01.404542 (+ 2974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:01.405262 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:01.405269 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:01.405271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:01.405417 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:01.405740 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:01.405743 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:01.405745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:01.406240 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:01.406466 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:01.406718 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 06:57:01.406904 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 06:57:01.407861 29700 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:01.498250 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 29569
I20260809 06:57:01.517124 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 29185
I20260809 06:57:01.518356 29252 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:01.638309 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 29185
2026-08-09T06:57:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4449 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T06:57:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:01Z Disabled control of system clock
I20260809 06:57:01.732456 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:45879
--webserver_interface=127.10.205.126
--webserver_port=0
--builtin_ntp_servers=127.10.205.84:34639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:45879
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 06:57:02.094005 29762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:02.094318 29762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:02.094404 29762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:02.101861 29762 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:02.101976 29762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:02.102015 29762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:02.102072 29762 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:02.102123 29762 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:02.111402 29762 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:45879
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:45879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:02.112722 29762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:02.114490 29762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:02.126380 29768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:02.126391 29767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:02.126727 29770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:02.127192 29762 server_base.cc:1034] running on GCE node
I20260809 06:57:02.128027 29762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:02.129588 29762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:02.130828 29762 hybrid_clock.cc:648] HybridClock initialized: now 1786258622130783 us; error 52 us; skew 500 ppm
I20260809 06:57:02.131194 29762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:57:02.138463 29762 webserver.cc:460] Webserver started at http://127.10.205.126:35197/ using document root <none> and password file <none>
I20260809 06:57:02.139253 29762 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:02.139393 29762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:02.139734 29762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:02.142892 29762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "9f5df5fe7d414f4686b7d785273dd394"
format_stamp: "Formatted at 2026-08-09 06:57:02 on dist-test-slave-0b58"
server_key: "2b7e13766be38b44fd4e7b55762c1797"
server_key_iv: "4fe421cf2ef32f132df028965d675808"
server_key_version: "encryptionkey@0"
I20260809 06:57:02.143760 29762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "9f5df5fe7d414f4686b7d785273dd394"
format_stamp: "Formatted at 2026-08-09 06:57:02 on dist-test-slave-0b58"
server_key: "2b7e13766be38b44fd4e7b55762c1797"
server_key_iv: "4fe421cf2ef32f132df028965d675808"
server_key_version: "encryptionkey@0"
I20260809 06:57:02.149312 29762 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 06:57:02.153019 29776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:02.154392 29762 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:57:02.154608 29762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "9f5df5fe7d414f4686b7d785273dd394"
format_stamp: "Formatted at 2026-08-09 06:57:02 on dist-test-slave-0b58"
server_key: "2b7e13766be38b44fd4e7b55762c1797"
server_key_iv: "4fe421cf2ef32f132df028965d675808"
server_key_version: "encryptionkey@0"
I20260809 06:57:02.154855 29762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:02.193346 29762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:02.194280 29762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:02.194622 29762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:02.213505 29762 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:45879
I20260809 06:57:02.213526 29830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:45879 every 8 connection(s)
I20260809 06:57:02.215063 29762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:02.219128 29831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:02.222129 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 29762
I20260809 06:57:02.222345 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:02.223047 11061 external_mini_cluster.cc:1428] Setting key 0154395c41c9a16ed764517f5c063dbd
I20260809 06:57:02.234220 29831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394: Bootstrap starting.
I20260809 06:57:02.238029 29831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:02.239431 29831 log.cc:824] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:02.242105 29834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:02.226550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35184 (local address 127.10.205.126:45879)
0809 06:57:02.229518 (+ 2968us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:02.229536 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:02.229913 (+ 377us) server_negotiation.cc:407] Connection header received
0809 06:57:02.232555 (+ 2642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:02.232581 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:02.233065 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:02.233418 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:02.234093 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:02.235479 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:02.237444 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:02.238146 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:02.238331 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:02.239705 (+ 1374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:02.239713 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:02.239727 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:02.240378 (+ 651us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:02.240465 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:02.240486 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:02.240634 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:02.240852 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 06:57:02.241158 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2348,"thread_start_us":1959,"threads_started":1}
I20260809 06:57:02.242654 29831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394: No bootstrap required, opened a new log
I20260809 06:57:02.250397 29831 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5df5fe7d414f4686b7d785273dd394" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45879 } }
I20260809 06:57:02.250934 29831 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:02.251065 29831 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5df5fe7d414f4686b7d785273dd394, State: Initialized, Role: FOLLOWER
I20260809 06:57:02.251724 29831 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5df5fe7d414f4686b7d785273dd394" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45879 } }
I20260809 06:57:02.251987 29831 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:02.252140 29831 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:02.252367 29831 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:02.254664 29831 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5df5fe7d414f4686b7d785273dd394" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45879 } }
I20260809 06:57:02.255221 29831 leader_election.cc:302] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f5df5fe7d414f4686b7d785273dd394; no voters:
I20260809 06:57:02.255859 29831 leader_election.cc:288] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:02.256012 29836 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:02.256784 29836 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5df5fe7d414f4686b7d785273dd394, State: Running, Role: LEADER
I20260809 06:57:02.257439 29836 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5df5fe7d414f4686b7d785273dd394" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45879 } }
I20260809 06:57:02.258378 29831 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:02.260484 29837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f5df5fe7d414f4686b7d785273dd394" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5df5fe7d414f4686b7d785273dd394" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45879 } } }
I20260809 06:57:02.260604 29838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f5df5fe7d414f4686b7d785273dd394. Latest consensus state: current_term: 1 leader_uuid: "9f5df5fe7d414f4686b7d785273dd394" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f5df5fe7d414f4686b7d785273dd394" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45879 } } }
I20260809 06:57:02.261036 29837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:02.261049 29838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:02.265878 29841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:02.270422 29841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:02.279603 29841 catalog_manager.cc:1347] Generated new cluster ID: d393b338d6a8452e80e17a93a1679f0a
I20260809 06:57:02.279748 29841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:02.293793 29841 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:02.295087 29841 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:02.303519 29841 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394: Generated new TSK 0
I20260809 06:57:02.304450 29841 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:02.319926 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:45879
--builtin_ntp_servers=127.10.205.84:34639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 06:57:02.674768 29856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:02.675076 29856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:02.675252 29856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:02.682502 29856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:02.682634 29856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:02.682812 29856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:57:02.691583 29856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:45879
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:02.692864 29856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:02.694733 29856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:02.708005 29862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:02.707950 29865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:02.708033 29863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:02.708851 29856 server_base.cc:1034] running on GCE node
I20260809 06:57:02.709405 29856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:02.710247 29856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:02.711439 29856 hybrid_clock.cc:648] HybridClock initialized: now 1786258622711397 us; error 39 us; skew 500 ppm
I20260809 06:57:02.711737 29856 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:57:02.713924 29856 webserver.cc:460] Webserver started at http://127.10.205.65:44829/ using document root <none> and password file <none>
I20260809 06:57:02.714581 29856 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:02.714690 29856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:02.715008 29856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:02.717839 29856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "989132a486c74755a4cc4b0212e1d260"
format_stamp: "Formatted at 2026-08-09 06:57:02 on dist-test-slave-0b58"
server_key: "9b1fe84dd31c4ea8705650d1a427dd33"
server_key_iv: "0e572c310d41d2b5b1e6689e262e44c2"
server_key_version: "encryptionkey@0"
I20260809 06:57:02.718642 29856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "989132a486c74755a4cc4b0212e1d260"
format_stamp: "Formatted at 2026-08-09 06:57:02 on dist-test-slave-0b58"
server_key: "9b1fe84dd31c4ea8705650d1a427dd33"
server_key_iv: "0e572c310d41d2b5b1e6689e262e44c2"
server_key_version: "encryptionkey@0"
I20260809 06:57:02.723768 29856 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 06:57:02.727108 29871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:02.728439 29856 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:57:02.728605 29856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "989132a486c74755a4cc4b0212e1d260"
format_stamp: "Formatted at 2026-08-09 06:57:02 on dist-test-slave-0b58"
server_key: "9b1fe84dd31c4ea8705650d1a427dd33"
server_key_iv: "0e572c310d41d2b5b1e6689e262e44c2"
server_key_version: "encryptionkey@0"
I20260809 06:57:02.728817 29856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:02.746433 29856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:02.747241 29856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:02.747550 29856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:02.748534 29856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:02.749975 29856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:02.750103 29856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:02.750227 29856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:02.750312 29856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:02.783499 29856 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:46153
I20260809 06:57:02.783562 29991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:46153 every 8 connection(s)
I20260809 06:57:02.784957 29856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:57:02.793578 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 29856
I20260809 06:57:02.793776 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:57:02.794235 11061 external_mini_cluster.cc:1428] Setting key b135c267f93664825a7c7afb8e0df719
I20260809 06:57:02.797312 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:45879
--builtin_ntp_servers=127.10.205.84:34639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 06:57:02.799018 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:02.788378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:54695 (local address 127.10.205.126:45879)
0809 06:57:02.788996 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:02.789001 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:02.790070 (+ 1069us) server_negotiation.cc:407] Connection header received
0809 06:57:02.791854 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:02.791861 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:02.791950 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:02.792073 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:02.793144 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:02.793986 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:02.796005 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:02.796595 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:02.796751 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:02.798034 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:02.798044 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:02.798052 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:02.798078 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:02.798136 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:02.798154 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:02.798254 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:02.798436 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 06:57:02.798545 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":330,"threads_started":1}
I20260809 06:57:02.799748 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:02.789010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45879 (local address 127.10.205.65:54695)
0809 06:57:02.789908 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:02.789955 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:02.791556 (+ 1601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:02.792347 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:02.792355 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:02.792439 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:02.792985 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:02.793001 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:02.794126 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:02.794131 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:02.795841 (+ 1710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:02.795857 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:02.796817 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:02.796823 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:02.797015 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:02.797733 (+ 718us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:57:02.797735 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:02.797772 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:57:02.797853 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:02.798247 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:02.798255 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:02.798260 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 06:57:02.798394 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 06:57:02.798673 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":285,"threads_started":1}
I20260809 06:57:02.801230 29992 heartbeater.cc:347] Connected to a master server at 127.10.205.126:45879
I20260809 06:57:02.801540 29992 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:02.802438 29992 heartbeater.cc:511] Master 127.10.205.126:45879 requested a full tablet report, sending...
I20260809 06:57:02.804760 29795 ts_manager.cc:194] Registered new tserver with Master: 989132a486c74755a4cc4b0212e1d260 (127.10.205.65:46153)
I20260809 06:57:02.806414 29795 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.205.65:54695
W20260809 06:57:03.136137 29996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:03.136581 29996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:03.136745 29996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:03.144526 29996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:03.144675 29996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:03.144896 29996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:57:03.154568 29996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:45879
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:03.155927 29996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:03.158001 29996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:03.171779 30004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:03.171828 30001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:03.171923 30002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:03.172781 29996 server_base.cc:1034] running on GCE node
I20260809 06:57:03.173413 29996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:03.174377 29996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:03.175608 29996 hybrid_clock.cc:648] HybridClock initialized: now 1786258623175563 us; error 55 us; skew 500 ppm
I20260809 06:57:03.175944 29996 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:57:03.178325 29996 webserver.cc:460] Webserver started at http://127.10.205.66:45137/ using document root <none> and password file <none>
I20260809 06:57:03.179034 29996 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:03.179168 29996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:03.179498 29996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:03.182760 29996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "f19c7e588dba45eaab045bf439b31cd3"
format_stamp: "Formatted at 2026-08-09 06:57:03 on dist-test-slave-0b58"
server_key: "fad89a2725c0ef371152d2dc761ad14d"
server_key_iv: "45289f9cc0cf09ec96b9a779cc7eecdd"
server_key_version: "encryptionkey@0"
I20260809 06:57:03.183642 29996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "f19c7e588dba45eaab045bf439b31cd3"
format_stamp: "Formatted at 2026-08-09 06:57:03 on dist-test-slave-0b58"
server_key: "fad89a2725c0ef371152d2dc761ad14d"
server_key_iv: "45289f9cc0cf09ec96b9a779cc7eecdd"
server_key_version: "encryptionkey@0"
I20260809 06:57:03.188949 29996 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260809 06:57:03.192404 30010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:03.193688 29996 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:57:03.193861 29996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "f19c7e588dba45eaab045bf439b31cd3"
format_stamp: "Formatted at 2026-08-09 06:57:03 on dist-test-slave-0b58"
server_key: "fad89a2725c0ef371152d2dc761ad14d"
server_key_iv: "45289f9cc0cf09ec96b9a779cc7eecdd"
server_key_version: "encryptionkey@0"
I20260809 06:57:03.194088 29996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:03.209275 29996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:03.210146 29996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:03.210467 29996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:03.211440 29996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:03.213035 29996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:03.213150 29996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:03.213259 29996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:03.213335 29996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:03.254627 29996 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:38927
I20260809 06:57:03.254678 30129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:38927 every 8 connection(s)
I20260809 06:57:03.255997 29996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:57:03.259717 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 29996
I20260809 06:57:03.259927 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:57:03.260453 11061 external_mini_cluster.cc:1428] Setting key d0f2b00d0feac51d3b78f8f65c30fb67
I20260809 06:57:03.263660 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:45879
--builtin_ntp_servers=127.10.205.84:34639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 06:57:03.270290 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.258780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:36351 (local address 127.10.205.126:45879)
0809 06:57:03.258959 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:03.258963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:03.260801 (+ 1838us) server_negotiation.cc:407] Connection header received
0809 06:57:03.263093 (+ 2292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:03.263098 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:03.263179 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:03.263299 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:03.264456 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.265691 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.267255 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.267929 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.268066 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.269381 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:03.269389 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:03.269397 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:03.269421 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:03.269464 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:03.269482 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:03.269570 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:03.269780 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 06:57:03.269887 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:57:03.271054 30132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.259460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45879 (local address 127.10.205.66:36351)
0809 06:57:03.260623 (+ 1163us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:03.260675 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:03.262842 (+ 2167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:03.263489 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:03.263497 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:03.263575 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:03.264201 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.264218 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.265818 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.265822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.267111 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.267123 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.268118 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.268122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.268376 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.269051 (+ 675us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:57:03.269054 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:03.269109 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:57:03.269181 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:03.269583 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:03.269592 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:03.269597 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 06:57:03.269724 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 06:57:03.269996 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":435,"threads_started":1}
I20260809 06:57:03.272548 30130 heartbeater.cc:347] Connected to a master server at 127.10.205.126:45879
I20260809 06:57:03.272876 30130 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:03.273785 30130 heartbeater.cc:511] Master 127.10.205.126:45879 requested a full tablet report, sending...
I20260809 06:57:03.275488 29795 ts_manager.cc:194] Registered new tserver with Master: f19c7e588dba45eaab045bf439b31cd3 (127.10.205.66:38927)
I20260809 06:57:03.276343 29795 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.205.66:36351
W20260809 06:57:03.608481 30133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:03.608781 30133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:03.608935 30133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:03.616232 30133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:03.616381 30133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:03.616555 30133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:57:03.626300 30133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:45879
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:03.627668 30133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:03.629493 30133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:03.642732 30140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:03.642777 30142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:03.642794 30138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:03.643556 30133 server_base.cc:1034] running on GCE node
I20260809 06:57:03.644152 30133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:03.645243 30133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:03.646490 30133 hybrid_clock.cc:648] HybridClock initialized: now 1786258623646447 us; error 48 us; skew 500 ppm
I20260809 06:57:03.646833 30133 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:57:03.649430 30133 webserver.cc:460] Webserver started at http://127.10.205.67:34997/ using document root <none> and password file <none>
I20260809 06:57:03.650199 30133 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:03.650344 30133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:03.650691 30133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:03.653990 30133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "571d6d765f0040938c72d328d563e8c1"
format_stamp: "Formatted at 2026-08-09 06:57:03 on dist-test-slave-0b58"
server_key: "1d34b4f5f2fef45dfd74aa64cfdcc591"
server_key_iv: "d34a3f436903ae9a0b44a0c055843016"
server_key_version: "encryptionkey@0"
I20260809 06:57:03.654865 30133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "571d6d765f0040938c72d328d563e8c1"
format_stamp: "Formatted at 2026-08-09 06:57:03 on dist-test-slave-0b58"
server_key: "1d34b4f5f2fef45dfd74aa64cfdcc591"
server_key_iv: "d34a3f436903ae9a0b44a0c055843016"
server_key_version: "encryptionkey@0"
I20260809 06:57:03.660808 30133 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.003s
I20260809 06:57:03.664472 30148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:03.665845 30133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:57:03.666025 30133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "571d6d765f0040938c72d328d563e8c1"
format_stamp: "Formatted at 2026-08-09 06:57:03 on dist-test-slave-0b58"
server_key: "1d34b4f5f2fef45dfd74aa64cfdcc591"
server_key_iv: "d34a3f436903ae9a0b44a0c055843016"
server_key_version: "encryptionkey@0"
I20260809 06:57:03.666276 30133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:03.684774 30133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:03.685657 30133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:03.685984 30133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:03.687012 30133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:03.688902 30133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:03.689073 30133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:03.689234 30133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:03.689343 30133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:03.723959 30133 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:43631
I20260809 06:57:03.724023 30266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:43631 every 8 connection(s)
I20260809 06:57:03.725412 30133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:57:03.726698 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 30133
I20260809 06:57:03.726900 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:57:03.727520 11061 external_mini_cluster.cc:1428] Setting key 371e9edfd8d4de77d75e804ee5f6efbb
I20260809 06:57:03.738927 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.728371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:56891 (local address 127.10.205.126:45879)
0809 06:57:03.728556 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:03.728560 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:03.730296 (+ 1736us) server_negotiation.cc:407] Connection header received
0809 06:57:03.732303 (+ 2007us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:03.732309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:03.732402 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:03.732507 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:03.733675 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.734443 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.736036 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.736509 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.736656 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.738086 (+ 1430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:03.738091 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:03.738094 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:03.738113 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:03.738145 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:03.738156 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:03.738247 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:03.738480 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 06:57:03.738586 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:57:03.740105 30270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.729098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45879 (local address 127.10.205.67:56891)
0809 06:57:03.730141 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:03.730181 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:03.731953 (+ 1772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:03.732765 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:03.732774 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:03.732863 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:03.733512 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.733531 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.734605 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.734610 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.735895 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.735908 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.736738 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.736745 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.736996 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.737727 (+ 731us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:57:03.737730 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:03.737786 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:57:03.737876 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:03.738263 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:03.738276 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:03.738288 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 06:57:03.738470 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 06:57:03.738905 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":389,"threads_started":1}
I20260809 06:57:03.741600 30267 heartbeater.cc:347] Connected to a master server at 127.10.205.126:45879
I20260809 06:57:03.741981 30267 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:03.742988 30267 heartbeater.cc:511] Master 127.10.205.126:45879 requested a full tablet report, sending...
I20260809 06:57:03.744450 29795 ts_manager.cc:194] Registered new tserver with Master: 571d6d765f0040938c72d328d563e8c1 (127.10.205.67:43631)
I20260809 06:57:03.745196 29795 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.205.67:56891
I20260809 06:57:03.755518 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:57:03.765763 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.760030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35188 (local address 127.10.205.126:45879)
0809 06:57:03.760337 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:03.760343 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:03.760633 (+ 290us) server_negotiation.cc:407] Connection header received
0809 06:57:03.760772 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:03.760775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:03.760850 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:03.760926 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:03.761408 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.762088 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.763467 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.763863 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.763952 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.765028 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:03.765032 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:03.765036 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:03.765053 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:03.765084 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:03.765094 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:03.765176 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:03.765304 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 06:57:03.765380 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:57:03.769529 29795 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:57:03.776670 29795 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:57:03.802950 30280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.789141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:38927 (local address 127.0.0.1:34392)
0809 06:57:03.790560 (+ 1419us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:03.790599 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:03.790786 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:03.792022 (+ 1236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:03.792034 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:03.792077 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:03.792623 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.792649 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.795247 (+ 2598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.795256 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.798446 (+ 3190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.798471 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.801588 (+ 3117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.801598 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.801911 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.801987 (+ 76us) client_negotiation.cc:769] Sending connection context
0809 06:57:03.802170 (+ 183us) client_negotiation.cc:240] Negotiation successful
0809 06:57:03.802455 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1128,"thread_start_us":868,"threads_started":1}
I20260809 06:57:03.804682 30281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.789733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34392 (local address 127.10.205.66:38927)
0809 06:57:03.790699 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:03.790707 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:03.790740 (+ 33us) server_negotiation.cc:407] Connection header received
0809 06:57:03.791092 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:03.791101 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:03.791420 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:03.791667 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:03.792886 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.794995 (+ 2109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.798775 (+ 3780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.800886 (+ 2111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.801061 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.801406 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:03.803883 (+ 2477us) server_negotiation.cc:299] Negotiation successful
0809 06:57:03.804161 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":794,"thread_start_us":1197,"threads_started":1}
I20260809 06:57:03.809252 30062 tablet_service.cc:1467] Processing CreateTablet for tablet d77c01d5067940d79c82e9aca9ac3d26 (DEFAULT_TABLE table=test-table [id=b145047e148f4f90823b2da58548795d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:03.810009 29992 heartbeater.cc:503] Master 127.10.205.126:45879 was elected leader, sending a full tablet report...
I20260809 06:57:03.810930 30062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d77c01d5067940d79c82e9aca9ac3d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:03.817076 30280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.790786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:43631 (local address 127.0.0.1:52584)
0809 06:57:03.803480 (+ 12694us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:03.803509 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:03.803653 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:03.810961 (+ 7308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:03.810966 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:03.810991 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:03.811177 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.811190 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.812892 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.812897 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.814418 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.814432 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.816211 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.816217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.816458 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.816495 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 06:57:03.816617 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 06:57:03.816764 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12524,"thread_start_us":14282,"threads_started":1}
I20260809 06:57:03.817198 30285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.792884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52584 (local address 127.10.205.67:43631)
0809 06:57:03.809132 (+ 16248us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:03.809141 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:03.809177 (+ 36us) server_negotiation.cc:407] Connection header received
0809 06:57:03.809282 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:03.809291 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:03.809563 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:03.809768 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:03.811403 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.812748 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.814622 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.816049 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.816185 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.816493 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:03.816658 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 06:57:03.816829 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16074,"thread_start_us":15929,"threads_started":1}
I20260809 06:57:03.819010 30283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.791148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37052 (local address 127.10.205.65:46153)
0809 06:57:03.810472 (+ 19324us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:03.810480 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:03.810511 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:57:03.810602 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:03.810609 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:03.810822 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:03.811016 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:03.811935 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.813509 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.816001 (+ 2492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.817522 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.817661 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.817915 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:03.818461 (+ 546us) server_negotiation.cc:299] Negotiation successful
0809 06:57:03.818631 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19132,"thread_start_us":18966,"threads_started":1}
I20260809 06:57:03.819177 30282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.791443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:46153 (local address 127.0.0.1:37052)
0809 06:57:03.805436 (+ 13993us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:03.805459 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:03.805608 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:03.811285 (+ 5677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:03.811290 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:03.811318 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:03.811702 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.811717 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.813654 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.813660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.815796 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.815811 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.818045 (+ 2234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.818051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.818240 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.818273 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 06:57:03.818367 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 06:57:03.818504 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13794,"thread_start_us":17027,"threads_started":1}
I20260809 06:57:03.821069 30198 tablet_service.cc:1467] Processing CreateTablet for tablet d77c01d5067940d79c82e9aca9ac3d26 (DEFAULT_TABLE table=test-table [id=b145047e148f4f90823b2da58548795d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:03.822324 30198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d77c01d5067940d79c82e9aca9ac3d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:03.824389 29924 tablet_service.cc:1467] Processing CreateTablet for tablet d77c01d5067940d79c82e9aca9ac3d26 (DEFAULT_TABLE table=test-table [id=b145047e148f4f90823b2da58548795d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:03.826915 29924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d77c01d5067940d79c82e9aca9ac3d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:03.829020 30286 tablet_bootstrap.cc:492] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3: Bootstrap starting.
I20260809 06:57:03.832959 30286 tablet_bootstrap.cc:654] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:03.834410 30286 log.cc:824] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:03.837373 30286 tablet_bootstrap.cc:492] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3: No bootstrap required, opened a new log
I20260809 06:57:03.837687 30286 ts_tablet_manager.cc:1397] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 06:57:03.839251 30288 tablet_bootstrap.cc:492] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1: Bootstrap starting.
I20260809 06:57:03.843146 30288 tablet_bootstrap.cc:654] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:03.844062 30289 tablet_bootstrap.cc:492] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260: Bootstrap starting.
I20260809 06:57:03.844437 30288 log.cc:824] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:03.847508 30289 tablet_bootstrap.cc:654] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:03.847791 30288 tablet_bootstrap.cc:492] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1: No bootstrap required, opened a new log
I20260809 06:57:03.848070 30288 ts_tablet_manager.cc:1397] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 06:57:03.848762 30289 log.cc:824] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:03.848452 30286 raft_consensus.cc:348] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f19c7e588dba45eaab045bf439b31cd3" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38927 } } peers { permanent_uuid: "989132a486c74755a4cc4b0212e1d260" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 46153 } } peers { permanent_uuid: "571d6d765f0040938c72d328d563e8c1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 43631 } }
I20260809 06:57:03.848939 30286 raft_consensus.cc:374] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:03.849108 30286 raft_consensus.cc:729] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f19c7e588dba45eaab045bf439b31cd3, State: Initialized, Role: FOLLOWER
I20260809 06:57:03.849865 30286 consensus_queue.cc:260] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f19c7e588dba45eaab045bf439b31cd3" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38927 } } peers { permanent_uuid: "989132a486c74755a4cc4b0212e1d260" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 46153 } } peers { permanent_uuid: "571d6d765f0040938c72d328d563e8c1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 43631 } }
I20260809 06:57:03.851583 30286 ts_tablet_manager.cc:1428] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260809 06:57:03.852079 30289 tablet_bootstrap.cc:492] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260: No bootstrap required, opened a new log
I20260809 06:57:03.852063 30130 heartbeater.cc:503] Master 127.10.205.126:45879 was elected leader, sending a full tablet report...
I20260809 06:57:03.852415 30289 ts_tablet_manager.cc:1397] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 06:57:03.857367 30288 raft_consensus.cc:348] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f19c7e588dba45eaab045bf439b31cd3" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38927 } } peers { permanent_uuid: "989132a486c74755a4cc4b0212e1d260" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 46153 } } peers { permanent_uuid: "571d6d765f0040938c72d328d563e8c1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 43631 } }
I20260809 06:57:03.857787 30288 raft_consensus.cc:374] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:03.857903 30288 raft_consensus.cc:729] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 571d6d765f0040938c72d328d563e8c1, State: Initialized, Role: FOLLOWER
I20260809 06:57:03.858623 30288 consensus_queue.cc:260] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f19c7e588dba45eaab045bf439b31cd3" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38927 } } peers { permanent_uuid: "989132a486c74755a4cc4b0212e1d260" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 46153 } } peers { permanent_uuid: "571d6d765f0040938c72d328d563e8c1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 43631 } }
I20260809 06:57:03.859887 30267 heartbeater.cc:503] Master 127.10.205.126:45879 was elected leader, sending a full tablet report...
I20260809 06:57:03.860531 30288 ts_tablet_manager.cc:1428] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1: Time spent starting tablet: real 0.012s user 0.010s sys 0.004s
I20260809 06:57:03.862069 30289 raft_consensus.cc:348] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f19c7e588dba45eaab045bf439b31cd3" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38927 } } peers { permanent_uuid: "989132a486c74755a4cc4b0212e1d260" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 46153 } } peers { permanent_uuid: "571d6d765f0040938c72d328d563e8c1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 43631 } }
I20260809 06:57:03.862560 30289 raft_consensus.cc:374] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:03.862680 30289 raft_consensus.cc:729] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989132a486c74755a4cc4b0212e1d260, State: Initialized, Role: FOLLOWER
I20260809 06:57:03.863229 30289 consensus_queue.cc:260] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f19c7e588dba45eaab045bf439b31cd3" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38927 } } peers { permanent_uuid: "989132a486c74755a4cc4b0212e1d260" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 46153 } } peers { permanent_uuid: "571d6d765f0040938c72d328d563e8c1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 43631 } }
I20260809 06:57:03.865113 30289 ts_tablet_manager.cc:1428] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260: Time spent starting tablet: real 0.013s user 0.007s sys 0.005s
I20260809 06:57:03.875810 30292 raft_consensus.cc:482] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:57:03.876091 30292 raft_consensus.cc:504] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f19c7e588dba45eaab045bf439b31cd3" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38927 } } peers { permanent_uuid: "989132a486c74755a4cc4b0212e1d260" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 46153 } } peers { permanent_uuid: "571d6d765f0040938c72d328d563e8c1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 43631 } }
I20260809 06:57:03.877761 30292 leader_election.cc:288] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 989132a486c74755a4cc4b0212e1d260 (127.10.205.65:46153), 571d6d765f0040938c72d328d563e8c1 (127.10.205.67:43631)
I20260809 06:57:03.886957 30285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.878335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:42179 (local address 127.10.205.67:43631)
0809 06:57:03.878525 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:03.878533 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:03.879091 (+ 558us) server_negotiation.cc:407] Connection header received
0809 06:57:03.879306 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:03.879312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:03.879394 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:03.879489 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:03.880399 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.881489 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.884517 (+ 3028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.885796 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.885968 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.886039 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:03.886565 (+ 526us) server_negotiation.cc:299] Negotiation successful
0809 06:57:03.886696 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 06:57:03.886957 30283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.878302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:38075 (local address 127.10.205.65:46153)
0809 06:57:03.878530 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:03.878539 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:03.879115 (+ 576us) server_negotiation.cc:407] Connection header received
0809 06:57:03.879306 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:03.879312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:03.879400 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:03.879489 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:03.880386 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.881489 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.884520 (+ 3031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.885795 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.885965 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.886039 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:03.886565 (+ 526us) server_negotiation.cc:299] Negotiation successful
0809 06:57:03.886697 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 06:57:03.887192 30296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.878134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:46153 (local address 127.10.205.66:38075)
0809 06:57:03.879019 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:03.879035 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:03.879146 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:03.879517 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:03.879523 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:03.879569 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:03.880214 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.880228 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.881622 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.881626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.884299 (+ 2673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.884315 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.886034 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.886041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.886297 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.886427 (+ 130us) client_negotiation.cc:769] Sending connection context
0809 06:57:03.886526 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 06:57:03.886744 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":777,"mutex_wait_us":363,"spinlock_wait_cycles":33408,"thread_start_us":575,"threads_started":1}
I20260809 06:57:03.887212 30295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.878028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:43631 (local address 127.10.205.66:42179)
0809 06:57:03.878957 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:03.878976 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:03.879141 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:03.879517 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:03.879523 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:03.879565 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:03.880214 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.880228 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.881620 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.881625 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.884306 (+ 2681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:03.884315 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.886020 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.886027 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:03.886325 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.886427 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 06:57:03.886526 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 06:57:03.886744 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"mutex_wait_us":236,"spinlock_wait_cycles":1408,"thread_start_us":513,"threads_started":1}
I20260809 06:57:03.888545 29946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d77c01d5067940d79c82e9aca9ac3d26" candidate_uuid: "f19c7e588dba45eaab045bf439b31cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989132a486c74755a4cc4b0212e1d260" is_pre_election: true
I20260809 06:57:03.888584 30218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d77c01d5067940d79c82e9aca9ac3d26" candidate_uuid: "f19c7e588dba45eaab045bf439b31cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "571d6d765f0040938c72d328d563e8c1" is_pre_election: true
I20260809 06:57:03.889118 30218 raft_consensus.cc:2454] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f19c7e588dba45eaab045bf439b31cd3 in term 0.
I20260809 06:57:03.889132 29946 raft_consensus.cc:2454] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f19c7e588dba45eaab045bf439b31cd3 in term 0.
I20260809 06:57:03.889799 30015 leader_election.cc:302] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 571d6d765f0040938c72d328d563e8c1, f19c7e588dba45eaab045bf439b31cd3; no voters:
I20260809 06:57:03.890200 30292 raft_consensus.cc:2781] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:57:03.890352 30292 raft_consensus.cc:482] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:57:03.890475 30292 raft_consensus.cc:3037] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:03.892755 30292 raft_consensus.cc:504] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f19c7e588dba45eaab045bf439b31cd3" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38927 } } peers { permanent_uuid: "989132a486c74755a4cc4b0212e1d260" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 46153 } } peers { permanent_uuid: "571d6d765f0040938c72d328d563e8c1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 43631 } }
I20260809 06:57:03.893394 30292 leader_election.cc:288] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [CANDIDATE]: Term 1 election: Requested vote from peers 989132a486c74755a4cc4b0212e1d260 (127.10.205.65:46153), 571d6d765f0040938c72d328d563e8c1 (127.10.205.67:43631)
I20260809 06:57:03.893823 29946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d77c01d5067940d79c82e9aca9ac3d26" candidate_uuid: "f19c7e588dba45eaab045bf439b31cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "989132a486c74755a4cc4b0212e1d260"
I20260809 06:57:03.893920 30218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d77c01d5067940d79c82e9aca9ac3d26" candidate_uuid: "f19c7e588dba45eaab045bf439b31cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "571d6d765f0040938c72d328d563e8c1"
I20260809 06:57:03.894055 29946 raft_consensus.cc:3037] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:03.894114 30218 raft_consensus.cc:3037] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:03.897372 29946 raft_consensus.cc:2454] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f19c7e588dba45eaab045bf439b31cd3 in term 1.
I20260809 06:57:03.897372 30218 raft_consensus.cc:2454] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f19c7e588dba45eaab045bf439b31cd3 in term 1.
I20260809 06:57:03.897881 30012 leader_election.cc:302] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 989132a486c74755a4cc4b0212e1d260, f19c7e588dba45eaab045bf439b31cd3; no voters:
I20260809 06:57:03.898233 30292 raft_consensus.cc:2781] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:03.898684 30292 raft_consensus.cc:686] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 1 LEADER]: Becoming Leader. State: Replica: f19c7e588dba45eaab045bf439b31cd3, State: Running, Role: LEADER
I20260809 06:57:03.899163 30292 consensus_queue.cc:237] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f19c7e588dba45eaab045bf439b31cd3" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38927 } } peers { permanent_uuid: "989132a486c74755a4cc4b0212e1d260" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 46153 } } peers { permanent_uuid: "571d6d765f0040938c72d328d563e8c1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 43631 } }
I20260809 06:57:03.904150 29794 catalog_manager.cc:5495] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f19c7e588dba45eaab045bf439b31cd3 (127.10.205.66). New cstate: current_term: 1 leader_uuid: "f19c7e588dba45eaab045bf439b31cd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f19c7e588dba45eaab045bf439b31cd3" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "989132a486c74755a4cc4b0212e1d260" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "571d6d765f0040938c72d328d563e8c1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 43631 } health_report { overall_health: UNKNOWN } } }
I20260809 06:57:03.920451 30281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.915364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34400 (local address 127.10.205.66:38927)
0809 06:57:03.915588 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:03.915592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:03.915610 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:57:03.915794 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:03.915798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:03.915892 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:03.916019 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:57:03.916372 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.917079 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.918487 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.918889 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.918977 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.919406 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:57:03.919916 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:57:03.920022 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:03.920111 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 06:57:03.920174 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:57:03.928793 30218 raft_consensus.cc:1261] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1 [term 1 FOLLOWER]: Refusing update from remote peer f19c7e588dba45eaab045bf439b31cd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:57:03.928793 29946 raft_consensus.cc:1261] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260 [term 1 FOLLOWER]: Refusing update from remote peer f19c7e588dba45eaab045bf439b31cd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:57:03.929821 30297 consensus_queue.cc:1035] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "989132a486c74755a4cc4b0212e1d260" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:57:03.930256 30292 consensus_queue.cc:1035] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "571d6d765f0040938c72d328d563e8c1" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 43631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:57:03.959887 29794 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:57:03.960206 29794 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:57:03.964087 29794 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9f5df5fe7d414f4686b7d785273dd394: Sending DeleteTablet for 3 replicas of tablet d77c01d5067940d79c82e9aca9ac3d26
I20260809 06:57:03.965390 29924 tablet_service.cc:1514] Processing DeleteTablet for tablet d77c01d5067940d79c82e9aca9ac3d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:03 UTC) from {username='slave'} at 127.0.0.1:37052
I20260809 06:57:03.965476 30198 tablet_service.cc:1514] Processing DeleteTablet for tablet d77c01d5067940d79c82e9aca9ac3d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:03 UTC) from {username='slave'} at 127.0.0.1:52584
I20260809 06:57:03.965695 30062 tablet_service.cc:1514] Processing DeleteTablet for tablet d77c01d5067940d79c82e9aca9ac3d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:03 UTC) from {username='slave'} at 127.0.0.1:34392
I20260809 06:57:03.966451 30312 tablet_replica.cc:330] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1: stopping tablet replica
I20260809 06:57:03.967022 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 29856
I20260809 06:57:03.967491 30312 raft_consensus.cc:2229] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:57:03.968070 30312 raft_consensus.cc:2258] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:03.972189 30313 tablet_replica.cc:330] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3: stopping tablet replica
I20260809 06:57:03.972846 30311 tablet_replica.cc:330] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260: stopping tablet replica
I20260809 06:57:03.973359 30311 raft_consensus.cc:2229] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:57:03.973563 30312 ts_tablet_manager.cc:1905] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:03.973866 30313 raft_consensus.cc:2229] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:57:03.974684 30313 raft_consensus.cc:2258] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:03.975402 30311 raft_consensus.cc:2258] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:03.976922 30313 ts_tablet_manager.cc:1905] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:03.979950 30283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:03.968442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37066 (local address 127.10.205.65:46153)
0809 06:57:03.968688 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:03.968698 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:03.971490 (+ 2792us) server_negotiation.cc:407] Connection header received
0809 06:57:03.971686 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:03.971692 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:03.971832 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:03.971954 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:03.972713 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.973908 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.975886 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:03.976564 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:03.976668 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:03.978174 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:03.978185 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:03.978201 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:03.978987 (+ 786us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:03.979047 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:03.979084 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:03.979172 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:03.979463 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 06:57:03.979583 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 06:57:03.980566 30311 ts_tablet_manager.cc:1905] T d77c01d5067940d79c82e9aca9ac3d26 P 989132a486c74755a4cc4b0212e1d260: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:03.981401 29987 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:03.984925 30312 ts_tablet_manager.cc:1918] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:03.985179 30312 log.cc:1196] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/d77c01d5067940d79c82e9aca9ac3d26
I20260809 06:57:03.985862 30312 ts_tablet_manager.cc:1939] T d77c01d5067940d79c82e9aca9ac3d26 P 571d6d765f0040938c72d328d563e8c1: Deleting consensus metadata
I20260809 06:57:03.988096 29781 catalog_manager.cc:4841] TS 571d6d765f0040938c72d328d563e8c1 (127.10.205.67:43631): tablet d77c01d5067940d79c82e9aca9ac3d26 (table test-table [id=b145047e148f4f90823b2da58548795d]) successfully deleted
I20260809 06:57:03.988730 30313 ts_tablet_manager.cc:1918] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:03.988924 30313 log.cc:1196] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/d77c01d5067940d79c82e9aca9ac3d26
I20260809 06:57:03.989411 30313 ts_tablet_manager.cc:1939] T d77c01d5067940d79c82e9aca9ac3d26 P f19c7e588dba45eaab045bf439b31cd3: Deleting consensus metadata
I20260809 06:57:03.990859 29781 catalog_manager.cc:4841] TS f19c7e588dba45eaab045bf439b31cd3 (127.10.205.66:38927): tablet d77c01d5067940d79c82e9aca9ac3d26 (table test-table [id=b145047e148f4f90823b2da58548795d]) successfully deleted
I20260809 06:57:04.091913 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 29856
I20260809 06:57:04.112339 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 29996
W20260809 06:57:04.112339 29779 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.205.65:46153 (error 108)
I20260809 06:57:04.114559 30282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:04.114031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:46153 (local address 127.0.0.1:37068)
0809 06:57:04.114222 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:04.114366 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:46153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260809 06:57:04.114840 29779 catalog_manager.cc:4584] TS 989132a486c74755a4cc4b0212e1d260 (127.10.205.65:46153): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d77c01d5067940d79c82e9aca9ac3d26: Network error: Client connection negotiation failed: client connection to 127.10.205.65:46153: connect: Connection refused (error 111)
I20260809 06:57:04.120326 30281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:04.113720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34402 (local address 127.10.205.66:38927)
0809 06:57:04.113945 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:04.113954 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:04.113974 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:57:04.114043 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:04.114048 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:04.114174 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:04.114308 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:04.114823 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:04.115736 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:04.117140 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:04.117581 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:04.117731 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:04.118822 (+ 1091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:04.118837 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:04.118851 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:04.119491 (+ 640us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:04.119542 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:04.119562 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:04.119676 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:04.119813 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 06:57:04.119923 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 06:57:04.121081 30124 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:04.168923 30282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:04.168374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:46153 (local address 127.0.0.1:37072)
0809 06:57:04.168628 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:04.168750 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:46153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 06:57:04.170094 30282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:04.169727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:46153 (local address 127.0.0.1:37078)
0809 06:57:04.169901 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:04.169970 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:46153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 06:57:04.231904 30282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:04.230365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:46153 (local address 127.0.0.1:37086)
0809 06:57:04.231554 (+ 1189us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:04.231688 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:46153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1035}
I20260809 06:57:04.232940 30282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:04.232605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:46153 (local address 127.0.0.1:37094)
0809 06:57:04.232759 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:04.232840 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:46153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 06:57:04.237219 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 29996
I20260809 06:57:04.258543 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 30133
I20260809 06:57:04.265703 30285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:04.259298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52590 (local address 127.10.205.67:43631)
0809 06:57:04.259505 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:04.259514 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:04.259558 (+ 44us) server_negotiation.cc:407] Connection header received
0809 06:57:04.259799 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:04.259804 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:04.259897 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:04.260006 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:04.260478 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:04.261228 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:04.262536 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:04.262974 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:04.263110 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:04.264311 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:04.264324 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:04.264344 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:04.264965 (+ 621us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:04.265013 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:04.265033 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:04.265157 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:04.265278 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 06:57:04.265394 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:57:04.266530 30262 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:04.313794 30282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:04.313268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:46153 (local address 127.0.0.1:37110)
0809 06:57:04.313497 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:04.313605 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:46153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260809 06:57:04.315047 30282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:04.314642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:46153 (local address 127.0.0.1:37116)
0809 06:57:04.314873 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:04.314943 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:46153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260809 06:57:04.355844 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 30133
I20260809 06:57:04.375274 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 29762
I20260809 06:57:04.376407 29826 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:04.486817 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 29762
2026-08-09T06:57:04Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2846 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:04 dist-test-slave-0b58 krb5kdc[30322](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:04 dist-test-slave-0b58 krb5kdc[30322](info): set up 2 sockets
Aug 09 06:57:04 dist-test-slave-0b58 krb5kdc[30322](info): commencing operation
krb5kdc: starting...
W20260809 06:57:05.639199 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.005s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:05 dist-test-slave-0b58 krb5kdc[30322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:57:05.951031 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:34067
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:43615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:34067
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:06.302238 30339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:06.302556 30339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:06.302726 30339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:06.310046 30339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:06.310196 30339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:06.310300 30339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:06.310395 30339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:06.310474 30339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:06.323532 30339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:43615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:34067
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:34067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:06.324997 30339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:06.326351 30339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:06.337999 30345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:06.338059 30347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:06.338088 30344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:06.339056 30339 server_base.cc:1034] running on GCE node
I20260809 06:57:06.339879 30339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:06.341400 30339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:06.342628 30339 hybrid_clock.cc:648] HybridClock initialized: now 1786258626342592 us; error 49 us; skew 500 ppm
I20260809 06:57:06.342984 30339 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:06 dist-test-slave-0b58 krb5kdc[30322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258626, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:06.346130 30339 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:57:06.347666 30339 webserver.cc:460] Webserver started at http://127.10.205.126:34251/ using document root <none> and password file <none>
I20260809 06:57:06.348469 30339 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:06.348611 30339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:06.348906 30339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:06.352321 30339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "1d769f977253443a959012ac4d79972e"
format_stamp: "Formatted at 2026-08-09 06:57:06 on dist-test-slave-0b58"
server_key: "813f2f2f15387f4634ab991fe9c670e6"
server_key_iv: "7b7b6a6a97aa05d7fd4fd8774b89c91f"
server_key_version: "encryptionkey@0"
I20260809 06:57:06.353062 30339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "1d769f977253443a959012ac4d79972e"
format_stamp: "Formatted at 2026-08-09 06:57:06 on dist-test-slave-0b58"
server_key: "813f2f2f15387f4634ab991fe9c670e6"
server_key_iv: "7b7b6a6a97aa05d7fd4fd8774b89c91f"
server_key_version: "encryptionkey@0"
I20260809 06:57:06.358053 30339 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:57:06.361373 30354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:06.362576 30339 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:57:06.362780 30339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "1d769f977253443a959012ac4d79972e"
format_stamp: "Formatted at 2026-08-09 06:57:06 on dist-test-slave-0b58"
server_key: "813f2f2f15387f4634ab991fe9c670e6"
server_key_iv: "7b7b6a6a97aa05d7fd4fd8774b89c91f"
server_key_version: "encryptionkey@0"
I20260809 06:57:06.362980 30339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:06.379180 30339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:06.383386 30339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:06.383672 30339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:06.402495 30339 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:34067
I20260809 06:57:06.402515 30405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:34067 every 8 connection(s)
I20260809 06:57:06.403892 30339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:06.404456 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 30339
I20260809 06:57:06.404680 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:06.405315 11061 external_mini_cluster.cc:1428] Setting key ab1505053f12556c1e81b335c3ec5acc
I20260809 06:57:06.408438 30406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:06.418766 30406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e: Bootstrap starting.
Aug 09 06:57:06 dist-test-slave-0b58 krb5kdc[30322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:06.422176 30406 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:06.423275 30406 log.cc:824] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:06.426201 30406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e: No bootstrap required, opened a new log
I20260809 06:57:06.427994 30410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:06.407170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45114 (local address 127.10.205.126:34067)
0809 06:57:06.407928 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:06.407939 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:06.407983 (+ 44us) server_negotiation.cc:407] Connection header received
0809 06:57:06.409802 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:06.409824 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:06.410177 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:06.410544 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:06.412135 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:06.413566 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:06.414889 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:06.415553 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:06.415749 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:06.420358 (+ 4609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:06.420367 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:06.420381 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:06.420427 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:06.423652 (+ 3225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:06.424559 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:06.424566 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:06.424572 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:06.424746 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:06.425172 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:06.425178 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:06.425181 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:06.425722 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:06.426020 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:06.426537 (+ 517us) server_negotiation.cc:299] Negotiation successful
0809 06:57:06.426988 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":331,"threads_started":1}
I20260809 06:57:06.435237 30406 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d769f977253443a959012ac4d79972e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34067 } }
I20260809 06:57:06.435773 30406 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:06.435909 30406 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d769f977253443a959012ac4d79972e, State: Initialized, Role: FOLLOWER
I20260809 06:57:06.436540 30406 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d769f977253443a959012ac4d79972e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34067 } }
I20260809 06:57:06.436756 30406 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:06.436857 30406 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:06.436990 30406 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:06.439826 30406 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d769f977253443a959012ac4d79972e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34067 } }
I20260809 06:57:06.440593 30406 leader_election.cc:302] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d769f977253443a959012ac4d79972e; no voters:
I20260809 06:57:06.441258 30406 leader_election.cc:288] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:06.441443 30412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:06.442154 30412 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [term 1 LEADER]: Becoming Leader. State: Replica: 1d769f977253443a959012ac4d79972e, State: Running, Role: LEADER
I20260809 06:57:06.442726 30412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d769f977253443a959012ac4d79972e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34067 } }
I20260809 06:57:06.443512 30406 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:06.445914 30413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d769f977253443a959012ac4d79972e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d769f977253443a959012ac4d79972e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34067 } } }
I20260809 06:57:06.445890 30414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d769f977253443a959012ac4d79972e. Latest consensus state: current_term: 1 leader_uuid: "1d769f977253443a959012ac4d79972e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d769f977253443a959012ac4d79972e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 34067 } } }
I20260809 06:57:06.446431 30413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:06.446439 30414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:06.448014 30417 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:06.453733 30417 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:06.462785 30417 catalog_manager.cc:1347] Generated new cluster ID: c00de8b55726423d93f0f265515fc01e
I20260809 06:57:06.462917 30417 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:06.515486 30417 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:06.516944 30417 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:06.531138 30417 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e: Generated new TSK 0
I20260809 06:57:06.532140 30417 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:57:06.611584 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34067
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:43615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:06.958047 30434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:06.958389 30434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:06.958549 30434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:06.965996 30434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:06.966192 30434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:06.966362 30434 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:57:06.976316 30434 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:43615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:06.977665 30434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:06.978997 30434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:06.991780 30439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:06.992004 30442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:06.992080 30440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:06.993162 30434 server_base.cc:1034] running on GCE node
I20260809 06:57:06.993772 30434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:06.994597 30434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:06.995814 30434 hybrid_clock.cc:648] HybridClock initialized: now 1786258626995765 us; error 42 us; skew 500 ppm
I20260809 06:57:06.996117 30434 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:06 dist-test-slave-0b58 krb5kdc[30322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258626, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:06.999334 30434 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:57:07.000911 30434 webserver.cc:460] Webserver started at http://127.10.205.65:39485/ using document root <none> and password file <none>
I20260809 06:57:07.001586 30434 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:07.001732 30434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:07.002043 30434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:07.005035 30434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "6d804ede56594cb49400c50264e29038"
format_stamp: "Formatted at 2026-08-09 06:57:06 on dist-test-slave-0b58"
server_key: "d1e8ac53b967dfe74037dfdea68211e4"
server_key_iv: "6092a6bd122fa811bd49cf6040bac1de"
server_key_version: "encryptionkey@0"
I20260809 06:57:07.005797 30434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "6d804ede56594cb49400c50264e29038"
format_stamp: "Formatted at 2026-08-09 06:57:06 on dist-test-slave-0b58"
server_key: "d1e8ac53b967dfe74037dfdea68211e4"
server_key_iv: "6092a6bd122fa811bd49cf6040bac1de"
server_key_version: "encryptionkey@0"
I20260809 06:57:07.010980 30434 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:57:07.014381 30449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:07.015551 30434 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:57:07.015712 30434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "6d804ede56594cb49400c50264e29038"
format_stamp: "Formatted at 2026-08-09 06:57:06 on dist-test-slave-0b58"
server_key: "d1e8ac53b967dfe74037dfdea68211e4"
server_key_iv: "6092a6bd122fa811bd49cf6040bac1de"
server_key_version: "encryptionkey@0"
I20260809 06:57:07.015899 30434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:07.037869 30434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:07.042369 30434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:07.042673 30434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:07.043709 30434 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:07.045281 30434 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:07.045382 30434 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:07.045543 30434 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:07.045609 30434 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:07.078940 30434 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:45175
I20260809 06:57:07.078998 30567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:45175 every 8 connection(s)
I20260809 06:57:07.080272 30434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:57:07.085284 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 30434
I20260809 06:57:07.085472 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:57:07.086027 11061 external_mini_cluster.cc:1428] Setting key fbc28679934df5cd6a1df5f48ca83bce
Aug 09 06:57:07 dist-test-slave-0b58 krb5kdc[30322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258626, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:07.102809 30570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:07.082668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:48119 (local address 127.10.205.126:34067)
0809 06:57:07.083105 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:07.083110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:07.083912 (+ 802us) server_negotiation.cc:407] Connection header received
0809 06:57:07.086323 (+ 2411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:07.086329 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:07.086401 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:07.086494 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:07.088357 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:07.089058 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:07.091520 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:07.091914 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:07.092003 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:07.096603 (+ 4600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:07.096608 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:07.096611 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:07.096645 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:07.099250 (+ 2605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:07.100177 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:07.100181 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:07.100183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:07.100384 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:07.100902 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:07.100906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:07.100908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:07.101165 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:07.101303 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:07.102058 (+ 755us) server_negotiation.cc:299] Negotiation successful
0809 06:57:07.102351 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":235,"threads_started":1}
I20260809 06:57:07.103441 30571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:07.083082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34067 (local address 127.10.205.65:48119)
0809 06:57:07.083763 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:07.083799 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:07.085992 (+ 2193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:07.086762 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:07.086770 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:07.087441 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:07.088147 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:07.088172 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:07.089217 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:07.089225 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:07.091391 (+ 2166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:07.091407 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:07.092138 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:07.092147 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:07.092495 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:07.093235 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:57:07.093281 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:07.096336 (+ 3055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:07.099386 (+ 3050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:07.099397 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:07.099416 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:07.100063 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:07.100485 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:07.100493 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:07.100499 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:07.100749 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:07.101322 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:07.101332 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:07.101678 (+ 346us) client_negotiation.cc:769] Sending connection context
0809 06:57:07.101901 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 06:57:07.102318 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":267,"threads_started":1}
I20260809 06:57:07.105034 30568 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34067
I20260809 06:57:07.105340 30568 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:07.106058 30568 heartbeater.cc:511] Master 127.10.205.126:34067 requested a full tablet report, sending...
I20260809 06:57:07.108110 30371 ts_manager.cc:194] Registered new tserver with Master: 6d804ede56594cb49400c50264e29038 (127.10.205.65:45175)
I20260809 06:57:07.109560 30371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:48119
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:57:07.153815 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34067
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:43615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:07.488016 30574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:07.488373 30574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:07.488565 30574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:07.495713 30574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:07.495824 30574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:07.495967 30574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:57:07.505802 30574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:43615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:07.507117 30574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:07.508531 30574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:07.521675 30579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:07.521701 30580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:07.521621 30582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:07.522719 30574 server_base.cc:1034] running on GCE node
I20260809 06:57:07.523376 30574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:07.524374 30574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:07.525573 30574 hybrid_clock.cc:648] HybridClock initialized: now 1786258627525528 us; error 36 us; skew 500 ppm
I20260809 06:57:07.525902 30574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:07 dist-test-slave-0b58 krb5kdc[30322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258627, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:07.533784 30574 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:57:07.535471 30574 webserver.cc:460] Webserver started at http://127.10.205.66:45773/ using document root <none> and password file <none>
I20260809 06:57:07.536208 30574 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:07.536406 30574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:07.536744 30574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:07.539687 30574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "3798eafdbba64b70b425d3a6dff0520f"
format_stamp: "Formatted at 2026-08-09 06:57:07 on dist-test-slave-0b58"
server_key: "0a1517df4a59ec3b0d2f67d0a6fdf20c"
server_key_iv: "c6d6001d655a479fa2cc3f7702d5c8e9"
server_key_version: "encryptionkey@0"
I20260809 06:57:07.540556 30574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "3798eafdbba64b70b425d3a6dff0520f"
format_stamp: "Formatted at 2026-08-09 06:57:07 on dist-test-slave-0b58"
server_key: "0a1517df4a59ec3b0d2f67d0a6fdf20c"
server_key_iv: "c6d6001d655a479fa2cc3f7702d5c8e9"
server_key_version: "encryptionkey@0"
I20260809 06:57:07.545884 30574 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:57:07.549597 30590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:07.550951 30574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:57:07.551115 30574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "3798eafdbba64b70b425d3a6dff0520f"
format_stamp: "Formatted at 2026-08-09 06:57:07 on dist-test-slave-0b58"
server_key: "0a1517df4a59ec3b0d2f67d0a6fdf20c"
server_key_iv: "c6d6001d655a479fa2cc3f7702d5c8e9"
server_key_version: "encryptionkey@0"
I20260809 06:57:07.551318 30574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:07.576056 30574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:07.580097 30574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:07.580430 30574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:07.581420 30574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:07.582756 30574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:07.582857 30574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:07.583006 30574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:07.583076 30574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:07.616735 30574 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:45611
I20260809 06:57:07.616823 30710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:45611 every 8 connection(s)
I20260809 06:57:07.618038 30574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:57:07.625008 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 30574
I20260809 06:57:07.625231 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:57:07.625833 11061 external_mini_cluster.cc:1428] Setting key 203f3df56073c61127054dfa8cd7d826
Aug 09 06:57:07 dist-test-slave-0b58 krb5kdc[30322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258627, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:07.641790 30713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:07.620624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:55007 (local address 127.10.205.126:34067)
0809 06:57:07.621091 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:07.621114 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:07.622028 (+ 914us) server_negotiation.cc:407] Connection header received
0809 06:57:07.623907 (+ 1879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:07.623913 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:07.624002 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:07.624118 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:07.626191 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:07.626977 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:07.629121 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:07.629559 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:07.629660 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:07.634182 (+ 4522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:07.634191 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:07.634199 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:07.634246 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:07.637941 (+ 3695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:07.638925 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:07.638932 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:07.638937 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:07.639090 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:07.639594 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:07.639601 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:07.639606 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:07.639980 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:07.640122 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:07.641075 (+ 953us) server_negotiation.cc:299] Negotiation successful
0809 06:57:07.641334 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":255,"threads_started":1}
I20260809 06:57:07.642964 30714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:07.621076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34067 (local address 127.10.205.66:55007)
0809 06:57:07.621854 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:07.621898 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:07.623621 (+ 1723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:07.624374 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:07.624382 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:07.625159 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:07.625989 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:07.626017 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:07.627134 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:07.627137 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:07.628977 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:07.628996 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:07.629791 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:07.629807 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:07.630146 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:07.630911 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:57:07.630947 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:07.633939 (+ 2992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:07.638114 (+ 4175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:07.638125 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:07.638145 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:07.638784 (+ 639us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:07.639205 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:07.639213 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:07.639219 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:07.639475 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:07.640123 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:07.640133 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:07.640638 (+ 505us) client_negotiation.cc:769] Sending connection context
0809 06:57:07.640961 (+ 323us) client_negotiation.cc:240] Negotiation successful
0809 06:57:07.641567 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":300,"threads_started":1}
I20260809 06:57:07.644997 30711 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34067
I20260809 06:57:07.645339 30711 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:07.646066 30711 heartbeater.cc:511] Master 127.10.205.126:34067 requested a full tablet report, sending...
I20260809 06:57:07.647703 30371 ts_manager.cc:194] Registered new tserver with Master: 3798eafdbba64b70b425d3a6dff0520f (127.10.205.66:45611)
I20260809 06:57:07.649011 30371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:55007
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:57:07.697398 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34067
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:43615
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:08.072628 30717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:08.072896 30717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:08.073036 30717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:08.080226 30717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:08.080410 30717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:08.080593 30717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:57:08.090394 30717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:43615
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:34067
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:08.091738 30717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:08.093089 30717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:08.109280 30725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:08.109320 30723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:08.112514 30568 heartbeater.cc:503] Master 127.10.205.126:34067 was elected leader, sending a full tablet report...
W20260809 06:57:08.112664 30722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:08.120509 30717 server_base.cc:1034] running on GCE node
I20260809 06:57:08.121218 30717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:08.122313 30717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:08.123541 30717 hybrid_clock.cc:648] HybridClock initialized: now 1786258628123476 us; error 57 us; skew 500 ppm
I20260809 06:57:08.123883 30717 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:08 dist-test-slave-0b58 krb5kdc[30322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258628, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:08.127710 30717 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:57:08.129380 30717 webserver.cc:460] Webserver started at http://127.10.205.67:44241/ using document root <none> and password file <none>
I20260809 06:57:08.130134 30717 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:08.130282 30717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:08.130601 30717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:08.133759 30717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "b634009932004958a5d11331ed780190"
format_stamp: "Formatted at 2026-08-09 06:57:08 on dist-test-slave-0b58"
server_key: "1116fc25c98941ea57f26c1a3e264391"
server_key_iv: "68bd3394309edee27dd8eeb5269b1268"
server_key_version: "encryptionkey@0"
I20260809 06:57:08.134572 30717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "b634009932004958a5d11331ed780190"
format_stamp: "Formatted at 2026-08-09 06:57:08 on dist-test-slave-0b58"
server_key: "1116fc25c98941ea57f26c1a3e264391"
server_key_iv: "68bd3394309edee27dd8eeb5269b1268"
server_key_version: "encryptionkey@0"
I20260809 06:57:08.140365 30717 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260809 06:57:08.144299 30732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:08.145815 30717 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:57:08.145991 30717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "b634009932004958a5d11331ed780190"
format_stamp: "Formatted at 2026-08-09 06:57:08 on dist-test-slave-0b58"
server_key: "1116fc25c98941ea57f26c1a3e264391"
server_key_iv: "68bd3394309edee27dd8eeb5269b1268"
server_key_version: "encryptionkey@0"
I20260809 06:57:08.146224 30717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:08.161156 30717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:08.165742 30717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:08.166045 30717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:08.167228 30717 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:08.168771 30717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:08.168872 30717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:08.169026 30717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:08.169098 30717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:08.206416 30717 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:36939
I20260809 06:57:08.206452 30849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:36939 every 8 connection(s)
I20260809 06:57:08.207839 30717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:57:08.210561 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 30717
I20260809 06:57:08.210785 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:57:08.211387 11061 external_mini_cluster.cc:1428] Setting key 3b3cd60fe3a36bc07dd84630140c69bb
Aug 09 06:57:08 dist-test-slave-0b58 krb5kdc[30322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258628, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:08.235687 30855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.212345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:42001 (local address 127.10.205.126:34067)
0809 06:57:08.216589 (+ 4244us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:08.216594 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:08.216610 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:57:08.216673 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:08.216677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:08.216758 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:08.216883 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:08.219186 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.220089 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.221771 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.222181 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.222320 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.226670 (+ 4350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:08.226678 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:08.226683 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:08.226740 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:08.231837 (+ 5097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:08.232971 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:08.232977 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:08.232980 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:08.233175 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:08.233809 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:08.233814 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:08.233836 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:08.234130 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:08.234310 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:08.235035 (+ 725us) server_negotiation.cc:299] Negotiation successful
0809 06:57:08.235271 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4136,"thread_start_us":4045,"threads_started":1}
I20260809 06:57:08.236819 30852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.211656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:34067 (local address 127.10.205.67:42001)
0809 06:57:08.212534 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:08.212589 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:08.214299 (+ 1710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:08.217194 (+ 2895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:08.217209 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:08.218103 (+ 894us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:08.219007 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:08.219035 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.220276 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.220282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:08.221610 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:08.221622 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.222428 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.222435 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:08.222676 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.223380 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:57:08.223403 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:08.226357 (+ 2954us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:08.232028 (+ 5671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:08.232039 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:08.232059 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:08.232818 (+ 759us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:08.233321 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:08.233329 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:08.233348 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:08.233666 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:08.234269 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:08.234278 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:08.234657 (+ 379us) client_negotiation.cc:769] Sending connection context
0809 06:57:08.234942 (+ 285us) client_negotiation.cc:240] Negotiation successful
0809 06:57:08.235506 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":344,"threads_started":1}
I20260809 06:57:08.238256 30850 heartbeater.cc:347] Connected to a master server at 127.10.205.126:34067
I20260809 06:57:08.238706 30850 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:08.239805 30850 heartbeater.cc:511] Master 127.10.205.126:34067 requested a full tablet report, sending...
I20260809 06:57:08.241595 30371 ts_manager.cc:194] Registered new tserver with Master: b634009932004958a5d11331ed780190 (127.10.205.67:36939)
I20260809 06:57:08.242497 30371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:42001
I20260809 06:57:08.245091 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:57:08.265554 30855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.251351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45124 (local address 127.10.205.126:34067)
0809 06:57:08.251622 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:08.251628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:08.251956 (+ 328us) server_negotiation.cc:407] Connection header received
0809 06:57:08.252140 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:08.252144 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:08.252237 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:08.252378 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:08.254215 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.254983 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.256429 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.256840 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.256987 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.259871 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:08.259877 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:08.259882 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:08.259924 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:08.262438 (+ 2514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:08.263316 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:08.263327 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:08.263330 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:08.263454 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:08.263940 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:08.263945 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:08.263947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:08.264335 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:08.264632 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:08.265037 (+ 405us) server_negotiation.cc:299] Negotiation successful
0809 06:57:08.265235 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:57:08.269635 30371 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45124:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:57:08.276582 30371 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:57:08.312978 30868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.288703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:45175 (local address 127.0.0.1:53928)
0809 06:57:08.303670 (+ 14967us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:08.303729 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:08.304025 (+ 296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:08.305397 (+ 1372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:08.305405 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:08.305432 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:08.305981 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:08.306002 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.307519 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.307523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:08.310049 (+ 2526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:08.310064 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.311845 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.311851 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:08.312036 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.312094 (+ 58us) client_negotiation.cc:769] Sending connection context
0809 06:57:08.312217 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 06:57:08.312486 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14595,"mutex_wait_us":46,"thread_start_us":17491,"threads_started":1}
I20260809 06:57:08.313860 30870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.289644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33916 (local address 127.10.205.66:45611)
0809 06:57:08.302650 (+ 13006us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:08.302661 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:08.305281 (+ 2620us) server_negotiation.cc:407] Connection header received
0809 06:57:08.305397 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:08.305404 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:08.305639 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:08.306663 (+ 1024us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:08.306936 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.308523 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.310857 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.312139 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.313064 (+ 925us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.313242 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:08.313329 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 06:57:08.313521 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12803,"thread_start_us":13018,"threads_started":1}
I20260809 06:57:08.314098 30866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.288770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53928 (local address 127.10.205.65:45175)
0809 06:57:08.302117 (+ 13347us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:08.302131 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:08.304307 (+ 2176us) server_negotiation.cc:407] Connection header received
0809 06:57:08.304452 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:08.304464 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:08.304815 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:08.305046 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:08.306228 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.307382 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.310224 (+ 2842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.311629 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.311819 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.313470 (+ 1651us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:08.313558 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 06:57:08.313760 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13064,"thread_start_us":12855,"threads_started":1}
I20260809 06:57:08.314157 30869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.289064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:45611 (local address 127.0.0.1:33916)
0809 06:57:08.305035 (+ 15971us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:08.305053 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:08.305191 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:08.305889 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:08.305894 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:08.305925 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:08.306453 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:08.306470 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.308683 (+ 2213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.308692 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:08.310698 (+ 2006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:08.310709 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.312440 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.312448 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:08.312640 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.312690 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 06:57:08.312762 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 06:57:08.312902 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15853,"mutex_wait_us":5,"thread_start_us":14052,"threads_started":1}
I20260809 06:57:08.314285 30867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.289403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:36939 (local address 127.0.0.1:44408)
0809 06:57:08.305738 (+ 16335us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:08.305757 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:08.305965 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:08.306937 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:08.306940 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:08.306965 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:08.307307 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:08.307319 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.309010 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.309018 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:08.311195 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:08.311211 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.313401 (+ 2190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.313407 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:08.313592 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.313634 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 06:57:08.313721 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 06:57:08.313861 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16196,"mutex_wait_us":1,"spinlock_wait_cycles":1792,"thread_start_us":15345,"threads_started":1}
I20260809 06:57:08.314947 30871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.290183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44408 (local address 127.10.205.67:36939)
0809 06:57:08.304512 (+ 14329us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:08.304524 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:08.305851 (+ 1327us) server_negotiation.cc:407] Connection header received
0809 06:57:08.306191 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:08.306198 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:08.306438 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:08.306602 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:08.307515 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.308795 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.311372 (+ 2577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.312900 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.313028 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.313249 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:08.314437 (+ 1188us) server_negotiation.cc:299] Negotiation successful
0809 06:57:08.314612 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14112,"thread_start_us":13899,"threads_started":1}
I20260809 06:57:08.317955 30642 tablet_service.cc:1467] Processing CreateTablet for tablet 0b296cad3707413c86489e566d754668 (DEFAULT_TABLE table=test-table [id=366eefa08b3f4b4f98e7e285f12ca114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:08.317950 30500 tablet_service.cc:1467] Processing CreateTablet for tablet 0b296cad3707413c86489e566d754668 (DEFAULT_TABLE table=test-table [id=366eefa08b3f4b4f98e7e285f12ca114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:08.319298 30642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b296cad3707413c86489e566d754668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:08.319372 30500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b296cad3707413c86489e566d754668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:08.319646 30783 tablet_service.cc:1467] Processing CreateTablet for tablet 0b296cad3707413c86489e566d754668 (DEFAULT_TABLE table=test-table [id=366eefa08b3f4b4f98e7e285f12ca114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:08.321120 30783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b296cad3707413c86489e566d754668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:08.331389 30872 tablet_bootstrap.cc:492] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f: Bootstrap starting.
I20260809 06:57:08.334468 30873 tablet_bootstrap.cc:492] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038: Bootstrap starting.
I20260809 06:57:08.336112 30874 tablet_bootstrap.cc:492] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190: Bootstrap starting.
I20260809 06:57:08.336961 30872 tablet_bootstrap.cc:654] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:08.338346 30873 tablet_bootstrap.cc:654] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:08.338353 30872 log.cc:824] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:08.339155 30874 tablet_bootstrap.cc:654] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:08.339574 30873 log.cc:824] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:08.340405 30874 log.cc:824] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:08.341825 30872 tablet_bootstrap.cc:492] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f: No bootstrap required, opened a new log
I20260809 06:57:08.342128 30872 ts_tablet_manager.cc:1397] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260809 06:57:08.342804 30873 tablet_bootstrap.cc:492] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038: No bootstrap required, opened a new log
I20260809 06:57:08.343063 30873 ts_tablet_manager.cc:1397] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260809 06:57:08.344219 30874 tablet_bootstrap.cc:492] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190: No bootstrap required, opened a new log
I20260809 06:57:08.344599 30874 ts_tablet_manager.cc:1397] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 06:57:08.352862 30874 raft_consensus.cc:348] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d804ede56594cb49400c50264e29038" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 45175 } } peers { permanent_uuid: "3798eafdbba64b70b425d3a6dff0520f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45611 } } peers { permanent_uuid: "b634009932004958a5d11331ed780190" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36939 } }
I20260809 06:57:08.353276 30874 raft_consensus.cc:374] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:08.353416 30874 raft_consensus.cc:729] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b634009932004958a5d11331ed780190, State: Initialized, Role: FOLLOWER
I20260809 06:57:08.354058 30874 consensus_queue.cc:260] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d804ede56594cb49400c50264e29038" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 45175 } } peers { permanent_uuid: "3798eafdbba64b70b425d3a6dff0520f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45611 } } peers { permanent_uuid: "b634009932004958a5d11331ed780190" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36939 } }
I20260809 06:57:08.354285 30872 raft_consensus.cc:348] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d804ede56594cb49400c50264e29038" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 45175 } } peers { permanent_uuid: "3798eafdbba64b70b425d3a6dff0520f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45611 } } peers { permanent_uuid: "b634009932004958a5d11331ed780190" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36939 } }
I20260809 06:57:08.354223 30873 raft_consensus.cc:348] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d804ede56594cb49400c50264e29038" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 45175 } } peers { permanent_uuid: "3798eafdbba64b70b425d3a6dff0520f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45611 } } peers { permanent_uuid: "b634009932004958a5d11331ed780190" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36939 } }
I20260809 06:57:08.354725 30873 raft_consensus.cc:374] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:08.354817 30872 raft_consensus.cc:374] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:08.354871 30873 raft_consensus.cc:729] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d804ede56594cb49400c50264e29038, State: Initialized, Role: FOLLOWER
I20260809 06:57:08.354943 30872 raft_consensus.cc:729] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3798eafdbba64b70b425d3a6dff0520f, State: Initialized, Role: FOLLOWER
I20260809 06:57:08.355314 30850 heartbeater.cc:503] Master 127.10.205.126:34067 was elected leader, sending a full tablet report...
I20260809 06:57:08.355742 30873 consensus_queue.cc:260] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d804ede56594cb49400c50264e29038" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 45175 } } peers { permanent_uuid: "3798eafdbba64b70b425d3a6dff0520f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45611 } } peers { permanent_uuid: "b634009932004958a5d11331ed780190" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36939 } }
I20260809 06:57:08.356194 30874 ts_tablet_manager.cc:1428] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260809 06:57:08.356976 30872 consensus_queue.cc:260] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d804ede56594cb49400c50264e29038" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 45175 } } peers { permanent_uuid: "3798eafdbba64b70b425d3a6dff0520f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45611 } } peers { permanent_uuid: "b634009932004958a5d11331ed780190" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36939 } }
I20260809 06:57:08.360150 30711 heartbeater.cc:503] Master 127.10.205.126:34067 was elected leader, sending a full tablet report...
I20260809 06:57:08.358814 30873 ts_tablet_manager.cc:1428] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038: Time spent starting tablet: real 0.016s user 0.010s sys 0.003s
I20260809 06:57:08.360863 30872 ts_tablet_manager.cc:1428] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f: Time spent starting tablet: real 0.019s user 0.015s sys 0.001s
W20260809 06:57:08.370234 30712 tablet.cc:2369] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:57:08.459770 30851 tablet.cc:2369] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:57:08.569942 30878 raft_consensus.cc:482] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:57:08.570290 30878 raft_consensus.cc:504] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d804ede56594cb49400c50264e29038" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 45175 } } peers { permanent_uuid: "3798eafdbba64b70b425d3a6dff0520f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45611 } } peers { permanent_uuid: "b634009932004958a5d11331ed780190" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36939 } }
I20260809 06:57:08.572083 30878 leader_election.cc:288] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d804ede56594cb49400c50264e29038 (127.10.205.65:45175), 3798eafdbba64b70b425d3a6dff0520f (127.10.205.66:45611)
I20260809 06:57:08.578636 30866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.572494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:39441 (local address 127.10.205.65:45175)
0809 06:57:08.572711 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:08.572718 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:08.572825 (+ 107us) server_negotiation.cc:407] Connection header received
0809 06:57:08.573158 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:08.573165 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:08.573252 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:08.573352 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:08.573807 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.574825 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.576733 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.577731 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.577863 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.577916 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:08.578248 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 06:57:08.578370 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 06:57:08.578651 30852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.572386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:45175 (local address 127.10.205.67:39441)
0809 06:57:08.572713 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:08.572732 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:08.572893 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:08.573384 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:08.573388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:08.573418 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:08.573647 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:08.573660 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.574966 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.574971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:08.576578 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:08.576590 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.577888 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.577895 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:08.578083 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.578122 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 06:57:08.578226 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 06:57:08.578384 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159}
I20260809 06:57:08.579146 30870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.572797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:39111 (local address 127.10.205.66:45611)
0809 06:57:08.573070 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:08.573079 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:08.573541 (+ 462us) server_negotiation.cc:407] Connection header received
0809 06:57:08.573697 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:08.573705 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:08.573808 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:08.573885 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:08.574519 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.575427 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.577303 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.578270 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.578403 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.578467 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:08.578884 (+ 417us) server_negotiation.cc:299] Negotiation successful
0809 06:57:08.578982 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 06:57:08.579783 30881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.572610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:45611 (local address 127.10.205.67:39111)
0809 06:57:08.573422 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:08.573444 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:08.573571 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:08.573934 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:08.573938 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:08.573963 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:08.574354 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:08.574366 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.575577 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.575581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:08.577146 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:08.577162 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.578469 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.578475 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:08.578665 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.578707 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 06:57:08.579410 (+ 703us) client_negotiation.cc:240] Negotiation successful
0809 06:57:08.579505 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"mutex_wait_us":1,"thread_start_us":458,"threads_started":1}
I20260809 06:57:08.579687 30521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b296cad3707413c86489e566d754668" candidate_uuid: "b634009932004958a5d11331ed780190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d804ede56594cb49400c50264e29038" is_pre_election: true
I20260809 06:57:08.580299 30521 raft_consensus.cc:2454] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b634009932004958a5d11331ed780190 in term 0.
I20260809 06:57:08.580786 30662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b296cad3707413c86489e566d754668" candidate_uuid: "b634009932004958a5d11331ed780190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3798eafdbba64b70b425d3a6dff0520f" is_pre_election: true
I20260809 06:57:08.580965 30734 leader_election.cc:302] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d804ede56594cb49400c50264e29038, b634009932004958a5d11331ed780190; no voters:
I20260809 06:57:08.581293 30662 raft_consensus.cc:2454] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b634009932004958a5d11331ed780190 in term 0.
I20260809 06:57:08.581348 30878 raft_consensus.cc:2781] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:57:08.581497 30878 raft_consensus.cc:482] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:57:08.581595 30878 raft_consensus.cc:3037] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 0 FOLLOWER]: Advancing to term 1
W20260809 06:57:08.582840 30569 tablet.cc:2369] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:57:08.584371 30878 raft_consensus.cc:504] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d804ede56594cb49400c50264e29038" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 45175 } } peers { permanent_uuid: "3798eafdbba64b70b425d3a6dff0520f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45611 } } peers { permanent_uuid: "b634009932004958a5d11331ed780190" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36939 } }
I20260809 06:57:08.585004 30878 leader_election.cc:288] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [CANDIDATE]: Term 1 election: Requested vote from peers 6d804ede56594cb49400c50264e29038 (127.10.205.65:45175), 3798eafdbba64b70b425d3a6dff0520f (127.10.205.66:45611)
I20260809 06:57:08.585373 30521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b296cad3707413c86489e566d754668" candidate_uuid: "b634009932004958a5d11331ed780190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d804ede56594cb49400c50264e29038"
I20260809 06:57:08.585475 30662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b296cad3707413c86489e566d754668" candidate_uuid: "b634009932004958a5d11331ed780190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3798eafdbba64b70b425d3a6dff0520f"
I20260809 06:57:08.585570 30521 raft_consensus.cc:3037] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:08.585698 30662 raft_consensus.cc:3037] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:08.588337 30521 raft_consensus.cc:2454] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b634009932004958a5d11331ed780190 in term 1.
I20260809 06:57:08.588572 30662 raft_consensus.cc:2454] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b634009932004958a5d11331ed780190 in term 1.
I20260809 06:57:08.588766 30734 leader_election.cc:302] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d804ede56594cb49400c50264e29038, b634009932004958a5d11331ed780190; no voters:
I20260809 06:57:08.589071 30878 raft_consensus.cc:2781] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:08.589532 30878 raft_consensus.cc:686] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 1 LEADER]: Becoming Leader. State: Replica: b634009932004958a5d11331ed780190, State: Running, Role: LEADER
I20260809 06:57:08.590024 30878 consensus_queue.cc:237] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d804ede56594cb49400c50264e29038" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 45175 } } peers { permanent_uuid: "3798eafdbba64b70b425d3a6dff0520f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45611 } } peers { permanent_uuid: "b634009932004958a5d11331ed780190" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36939 } }
I20260809 06:57:08.594542 30369 catalog_manager.cc:5495] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 reported cstate change: term changed from 0 to 1, leader changed from <none> to b634009932004958a5d11331ed780190 (127.10.205.67). New cstate: current_term: 1 leader_uuid: "b634009932004958a5d11331ed780190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d804ede56594cb49400c50264e29038" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 45175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3798eafdbba64b70b425d3a6dff0520f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b634009932004958a5d11331ed780190" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 36939 } health_report { overall_health: HEALTHY } } }
I20260809 06:57:08.613751 30871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.608439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44424 (local address 127.10.205.67:36939)
0809 06:57:08.608663 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:08.608671 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:08.608711 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:57:08.608894 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:08.608898 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:08.608972 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:08.609109 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:57:08.609474 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.610172 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.611597 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.611990 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.612081 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.612646 (+ 565us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:57:08.613136 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:57:08.613267 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:08.613404 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 06:57:08.613467 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:57:08.622427 30662 raft_consensus.cc:1261] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f [term 1 FOLLOWER]: Refusing update from remote peer b634009932004958a5d11331ed780190: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:57:08.622558 30521 raft_consensus.cc:1261] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038 [term 1 FOLLOWER]: Refusing update from remote peer b634009932004958a5d11331ed780190: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:57:08.623493 30882 consensus_queue.cc:1035] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3798eafdbba64b70b425d3a6dff0520f" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:57:08.623875 30878 consensus_queue.cc:1035] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d804ede56594cb49400c50264e29038" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 45175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:57:08.641841 30888 mvcc.cc:205] Tried to move back new op lower bound from 7316515342826926080 to 7316515342708617216. Current Snapshot: MvccSnapshot[applied={T|T < 7316515342826926080}]
I20260809 06:57:08.657665 30369 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:57:08.658234 30369 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:57:08.662084 30369 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1d769f977253443a959012ac4d79972e: Sending DeleteTablet for 3 replicas of tablet 0b296cad3707413c86489e566d754668
I20260809 06:57:08.663367 30642 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b296cad3707413c86489e566d754668 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:08 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:33916
I20260809 06:57:08.663367 30500 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b296cad3707413c86489e566d754668 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:08 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:53928
I20260809 06:57:08.663443 30783 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b296cad3707413c86489e566d754668 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:08 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:44408
I20260809 06:57:08.665014 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 30434
I20260809 06:57:08.684897 30898 tablet_replica.cc:330] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190: stopping tablet replica
I20260809 06:57:08.684226 30896 tablet_replica.cc:330] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f: stopping tablet replica
I20260809 06:57:08.685194 30897 tablet_replica.cc:330] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038: stopping tablet replica
I20260809 06:57:08.685767 30896 raft_consensus.cc:2229] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:57:08.685752 30897 raft_consensus.cc:2229] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:57:08.686262 30898 raft_consensus.cc:2229] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:57:08.686349 30897 raft_consensus.cc:2258] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:08.687069 30898 raft_consensus.cc:2258] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:08.687628 30896 raft_consensus.cc:2258] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:08.688866 30897 ts_tablet_manager.cc:1905] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:08.690407 30896 ts_tablet_manager.cc:1905] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 06:57:08 dist-test-slave-0b58 krb5kdc[30322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:57:08.696337 30897 ts_tablet_manager.cc:1918] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:08.696314 30898 ts_tablet_manager.cc:1905] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:08.696550 30897 log.cc:1196] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/0b296cad3707413c86489e566d754668
I20260809 06:57:08.697180 30897 ts_tablet_manager.cc:1939] T 0b296cad3707413c86489e566d754668 P 6d804ede56594cb49400c50264e29038: Deleting consensus metadata
I20260809 06:57:08.699213 30356 catalog_manager.cc:4841] TS 6d804ede56594cb49400c50264e29038 (127.10.205.65:45175): tablet 0b296cad3707413c86489e566d754668 (table test-table [id=366eefa08b3f4b4f98e7e285f12ca114]) successfully deleted
I20260809 06:57:08.700006 30866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.666146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53942 (local address 127.10.205.65:45175)
0809 06:57:08.666354 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:08.666360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:08.673597 (+ 7237us) server_negotiation.cc:407] Connection header received
0809 06:57:08.674664 (+ 1067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:08.674674 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:08.674806 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:08.674898 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:08.679585 (+ 4687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.681146 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.685038 (+ 3892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.685740 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.685854 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.691870 (+ 6016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:08.691885 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:08.691901 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:08.691948 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:08.696095 (+ 4147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:08.697084 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:08.697095 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:08.697102 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:08.697297 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:08.697774 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:08.697782 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:08.697785 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:08.698261 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:08.698560 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:08.699367 (+ 807us) server_negotiation.cc:299] Negotiation successful
0809 06:57:08.699603 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:57:08.700877 30563 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:08.703481 30896 ts_tablet_manager.cc:1918] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:08.703694 30896 log.cc:1196] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/0b296cad3707413c86489e566d754668
I20260809 06:57:08.704319 30896 ts_tablet_manager.cc:1939] T 0b296cad3707413c86489e566d754668 P 3798eafdbba64b70b425d3a6dff0520f: Deleting consensus metadata
I20260809 06:57:08.705771 30898 ts_tablet_manager.cc:1918] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:08.706015 30898 log.cc:1196] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/0b296cad3707413c86489e566d754668
I20260809 06:57:08.706274 30358 catalog_manager.cc:4841] TS 3798eafdbba64b70b425d3a6dff0520f (127.10.205.66:45611): tablet 0b296cad3707413c86489e566d754668 (table test-table [id=366eefa08b3f4b4f98e7e285f12ca114]) successfully deleted
I20260809 06:57:08.706779 30898 ts_tablet_manager.cc:1939] T 0b296cad3707413c86489e566d754668 P b634009932004958a5d11331ed780190: Deleting consensus metadata
I20260809 06:57:08.709331 30355 catalog_manager.cc:4841] TS b634009932004958a5d11331ed780190 (127.10.205.67:36939): tablet 0b296cad3707413c86489e566d754668 (table test-table [id=366eefa08b3f4b4f98e7e285f12ca114]) successfully deleted
I20260809 06:57:08.798643 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 30434
I20260809 06:57:08.820086 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 30574
Aug 09 06:57:08 dist-test-slave-0b58 krb5kdc[30322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:57:08.838052 30870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.820951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33918 (local address 127.10.205.66:45611)
0809 06:57:08.821123 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:08.821127 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:08.821187 (+ 60us) server_negotiation.cc:407] Connection header received
0809 06:57:08.821379 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:08.821382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:08.821460 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:08.821553 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:08.823269 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.823998 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.825937 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.826333 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.826426 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.831976 (+ 5550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:08.831993 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:08.832009 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:08.832044 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:08.835207 (+ 3163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:08.836042 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:08.836049 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:08.836052 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:08.836178 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:08.836589 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:08.836592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:08.836595 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:08.836986 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:08.837213 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:08.837568 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 06:57:08.837733 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:57:08.838764 30705 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:08.929426 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 30574
I20260809 06:57:08.954444 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 30717
Aug 09 06:57:08 dist-test-slave-0b58 krb5kdc[30322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:57:08.972481 30871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:08.955271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44434 (local address 127.10.205.67:36939)
0809 06:57:08.955475 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:08.955480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:08.955506 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:57:08.955655 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:08.955661 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:08.955765 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:08.955906 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:08.957309 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.958508 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.959772 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:08.960570 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:08.960715 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:08.965083 (+ 4368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:08.965098 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:08.965119 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:08.965162 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:08.969545 (+ 4383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:08.970252 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:08.970262 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:08.970266 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:08.970457 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:08.970815 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:08.970820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:08.970823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:08.971312 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:08.971651 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:08.971819 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 06:57:08.972046 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 06:57:08.973424 30844 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:09.095505 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 30717
I20260809 06:57:09.117763 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 30339
I20260809 06:57:09.118906 30401 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:09.228350 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 30339
2026-08-09T06:57:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4742 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T06:57:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:09Z Disabled control of system clock
I20260809 06:57:09.322556 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:43085
--webserver_interface=127.10.205.126
--webserver_port=0
--builtin_ntp_servers=127.10.205.84:40235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:43085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 06:57:09.675223 30907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:09.675518 30907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:09.675602 30907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:09.683032 30907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:09.683144 30907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:09.683183 30907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:09.683241 30907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:09.683295 30907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:09.692829 30907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:43085
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:43085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:09.694101 30907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:09.695920 30907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:09.707823 30913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:09.707791 30914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:09.708381 30916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:09.708662 30907 server_base.cc:1034] running on GCE node
I20260809 06:57:09.709403 30907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:09.710724 30907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:09.711958 30907 hybrid_clock.cc:648] HybridClock initialized: now 1786258629711919 us; error 65 us; skew 500 ppm
I20260809 06:57:09.712375 30907 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:57:09.714641 30907 webserver.cc:460] Webserver started at http://127.10.205.126:40865/ using document root <none> and password file <none>
I20260809 06:57:09.715368 30907 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:09.715504 30907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:09.715840 30907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:09.718817 30907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "cd68011157a84e87a1a9ee8e55db709e"
format_stamp: "Formatted at 2026-08-09 06:57:09 on dist-test-slave-0b58"
server_key: "58266963b37a4d2059f9f02b70d91f9a"
server_key_iv: "e37f0f8c462519ccbc42eb1d321528ef"
server_key_version: "encryptionkey@0"
I20260809 06:57:09.719684 30907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "cd68011157a84e87a1a9ee8e55db709e"
format_stamp: "Formatted at 2026-08-09 06:57:09 on dist-test-slave-0b58"
server_key: "58266963b37a4d2059f9f02b70d91f9a"
server_key_iv: "e37f0f8c462519ccbc42eb1d321528ef"
server_key_version: "encryptionkey@0"
I20260809 06:57:09.725059 30907 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 06:57:09.728664 30922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:09.730041 30907 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:57:09.730254 30907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "cd68011157a84e87a1a9ee8e55db709e"
format_stamp: "Formatted at 2026-08-09 06:57:09 on dist-test-slave-0b58"
server_key: "58266963b37a4d2059f9f02b70d91f9a"
server_key_iv: "e37f0f8c462519ccbc42eb1d321528ef"
server_key_version: "encryptionkey@0"
I20260809 06:57:09.730495 30907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:09.759385 30907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:09.760381 30907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:09.760694 30907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:09.779971 30907 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:43085
I20260809 06:57:09.779999 30974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:43085 every 8 connection(s)
I20260809 06:57:09.781421 30907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:09.783107 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 30907
I20260809 06:57:09.783293 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:09.783808 11061 external_mini_cluster.cc:1428] Setting key 720c43499950670a73d3da015af335b0
I20260809 06:57:09.785789 30975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:09.799368 30978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:09.785804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60858 (local address 127.10.205.126:43085)
0809 06:57:09.786938 (+ 1134us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:09.786953 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:09.787007 (+ 54us) server_negotiation.cc:407] Connection header received
0809 06:57:09.789088 (+ 2081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:09.789115 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:09.789719 (+ 604us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:09.790152 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:09.790678 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:09.792792 (+ 2114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:09.794037 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:09.795022 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:09.795206 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:09.796414 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:09.796425 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:09.796448 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:09.797216 (+ 768us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:09.797317 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:09.797349 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:09.797473 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:09.797714 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 06:57:09.798062 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":371,"threads_started":1}
I20260809 06:57:09.800921 30975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e: Bootstrap starting.
I20260809 06:57:09.803915 30975 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:09.804978 30975 log.cc:824] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:09.807765 30975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e: No bootstrap required, opened a new log
I20260809 06:57:09.815930 30975 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd68011157a84e87a1a9ee8e55db709e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 43085 } }
I20260809 06:57:09.816359 30975 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:09.816483 30975 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd68011157a84e87a1a9ee8e55db709e, State: Initialized, Role: FOLLOWER
I20260809 06:57:09.817121 30975 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd68011157a84e87a1a9ee8e55db709e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 43085 } }
I20260809 06:57:09.817368 30975 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:09.817494 30975 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:09.817700 30975 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:09.820127 30975 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd68011157a84e87a1a9ee8e55db709e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 43085 } }
I20260809 06:57:09.820691 30975 leader_election.cc:302] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd68011157a84e87a1a9ee8e55db709e; no voters:
I20260809 06:57:09.821292 30975 leader_election.cc:288] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:09.821461 30980 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:09.822115 30980 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [term 1 LEADER]: Becoming Leader. State: Replica: cd68011157a84e87a1a9ee8e55db709e, State: Running, Role: LEADER
I20260809 06:57:09.822736 30980 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd68011157a84e87a1a9ee8e55db709e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 43085 } }
I20260809 06:57:09.824620 30980 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd68011157a84e87a1a9ee8e55db709e. Latest consensus state: current_term: 1 leader_uuid: "cd68011157a84e87a1a9ee8e55db709e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd68011157a84e87a1a9ee8e55db709e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 43085 } } }
I20260809 06:57:09.824950 30980 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:09.825708 30982 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd68011157a84e87a1a9ee8e55db709e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd68011157a84e87a1a9ee8e55db709e" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 43085 } } }
I20260809 06:57:09.826210 30982 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:09.829696 30975 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:09.829923 30985 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:09.836098 30985 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:09.846371 30985 catalog_manager.cc:1347] Generated new cluster ID: 7c4524f87c8e40a0884191b53346c7b0
I20260809 06:57:09.846485 30985 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:09.894430 30985 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:09.895753 30985 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:09.901067 30985 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e: Generated new TSK 0
I20260809 06:57:09.902225 30985 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:09.916294 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:43085
--builtin_ntp_servers=127.10.205.84:40235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 06:57:10.268006 31001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:10.268362 31001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:10.268525 31001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:10.275938 31001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:10.276079 31001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:10.276249 31001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:57:10.285575 31001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:43085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:10.286957 31001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:10.288820 31001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:10.302224 31006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:10.302196 31007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:10.302294 31009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:10.303160 31001 server_base.cc:1034] running on GCE node
I20260809 06:57:10.303907 31001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:10.304937 31001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:10.306192 31001 hybrid_clock.cc:648] HybridClock initialized: now 1786258630306128 us; error 53 us; skew 500 ppm
I20260809 06:57:10.306543 31001 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:57:10.309020 31001 webserver.cc:460] Webserver started at http://127.10.205.65:45693/ using document root <none> and password file <none>
I20260809 06:57:10.309788 31001 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:10.309921 31001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:10.310256 31001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:10.313345 31001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "760c52773c5846ea8bb261c9ed2875c6"
format_stamp: "Formatted at 2026-08-09 06:57:10 on dist-test-slave-0b58"
server_key: "e36796279d08dad0ad53434e028c67bf"
server_key_iv: "91f450f25e1aab176cf1d827e79915e9"
server_key_version: "encryptionkey@0"
I20260809 06:57:10.314163 31001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "760c52773c5846ea8bb261c9ed2875c6"
format_stamp: "Formatted at 2026-08-09 06:57:10 on dist-test-slave-0b58"
server_key: "e36796279d08dad0ad53434e028c67bf"
server_key_iv: "91f450f25e1aab176cf1d827e79915e9"
server_key_version: "encryptionkey@0"
I20260809 06:57:10.319512 31001 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 06:57:10.323076 31016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:10.324466 31001 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:57:10.324635 31001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "760c52773c5846ea8bb261c9ed2875c6"
format_stamp: "Formatted at 2026-08-09 06:57:10 on dist-test-slave-0b58"
server_key: "e36796279d08dad0ad53434e028c67bf"
server_key_iv: "91f450f25e1aab176cf1d827e79915e9"
server_key_version: "encryptionkey@0"
I20260809 06:57:10.324849 31001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:10.339017 31001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:10.339875 31001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:10.340194 31001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:10.341351 31001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:10.342800 31001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:10.342924 31001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:10.343058 31001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:10.343148 31001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:10.376840 31001 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:43693
I20260809 06:57:10.376895 31132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:43693 every 8 connection(s)
I20260809 06:57:10.378189 31001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:57:10.380151 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 31001
I20260809 06:57:10.380383 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:57:10.381000 11061 external_mini_cluster.cc:1428] Setting key c94dbc0db722f0fa8779696428a64d95
I20260809 06:57:10.384387 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:43085
--builtin_ntp_servers=127.10.205.84:40235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 06:57:10.393106 31135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:10.380901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:35321 (local address 127.10.205.126:43085)
0809 06:57:10.381486 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:10.381492 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:10.382723 (+ 1231us) server_negotiation.cc:407] Connection header received
0809 06:57:10.385377 (+ 2654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:10.385381 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:10.385446 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:10.385538 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:10.386992 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:10.387715 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:10.390192 (+ 2477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:10.390596 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:10.390687 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:10.392380 (+ 1693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:10.392386 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:10.392389 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:10.392406 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:10.392445 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:10.392457 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:10.392526 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:10.392779 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 06:57:10.392856 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":325,"threads_started":1}
I20260809 06:57:10.394590 31137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:10.381529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:43085 (local address 127.10.205.65:35321)
0809 06:57:10.382562 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:10.382606 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:10.385094 (+ 2488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:10.385819 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:10.385833 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:10.385954 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:10.386811 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:10.386839 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:10.387882 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:10.387890 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:10.390037 (+ 2147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:10.390055 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:10.390830 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:10.390840 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:10.391188 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:10.391969 (+ 781us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:57:10.391974 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:10.392027 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:57:10.392130 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:10.392558 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:10.392571 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:10.392582 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 06:57:10.392765 (+ 183us) client_negotiation.cc:240] Negotiation successful
0809 06:57:10.393193 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":350,"threads_started":1}
I20260809 06:57:10.396191 31133 heartbeater.cc:347] Connected to a master server at 127.10.205.126:43085
I20260809 06:57:10.396530 31133 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:10.397413 31133 heartbeater.cc:511] Master 127.10.205.126:43085 requested a full tablet report, sending...
I20260809 06:57:10.399693 30939 ts_manager.cc:194] Registered new tserver with Master: 760c52773c5846ea8bb261c9ed2875c6 (127.10.205.65:43693)
I20260809 06:57:10.401688 30939 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.205.65:35321
W20260809 06:57:10.736337 31138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:10.736625 31138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:10.736814 31138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:10.743971 31138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:10.744074 31138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:10.744273 31138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:57:10.754005 31138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:43085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:10.755592 31138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:10.757463 31138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:10.771015 31145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:10.770953 31147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:10.770990 31144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:10.773639 31138 server_base.cc:1034] running on GCE node
I20260809 06:57:10.774343 31138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:10.775359 31138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:10.776600 31138 hybrid_clock.cc:648] HybridClock initialized: now 1786258630776553 us; error 51 us; skew 500 ppm
I20260809 06:57:10.776949 31138 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:57:10.779507 31138 webserver.cc:460] Webserver started at http://127.10.205.66:35459/ using document root <none> and password file <none>
I20260809 06:57:10.780242 31138 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:10.780434 31138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:10.780764 31138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:10.783669 31138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "befff58b978e45209c5d923034dd6ce9"
format_stamp: "Formatted at 2026-08-09 06:57:10 on dist-test-slave-0b58"
server_key: "279b13a152dab4178646de28448d654e"
server_key_iv: "c3b4372b4c308795211be7cee1c98e68"
server_key_version: "encryptionkey@0"
I20260809 06:57:10.784554 31138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "befff58b978e45209c5d923034dd6ce9"
format_stamp: "Formatted at 2026-08-09 06:57:10 on dist-test-slave-0b58"
server_key: "279b13a152dab4178646de28448d654e"
server_key_iv: "c3b4372b4c308795211be7cee1c98e68"
server_key_version: "encryptionkey@0"
I20260809 06:57:10.789898 31138 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260809 06:57:10.793398 31153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:10.794632 31138 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 06:57:10.794826 31138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "befff58b978e45209c5d923034dd6ce9"
format_stamp: "Formatted at 2026-08-09 06:57:10 on dist-test-slave-0b58"
server_key: "279b13a152dab4178646de28448d654e"
server_key_iv: "c3b4372b4c308795211be7cee1c98e68"
server_key_version: "encryptionkey@0"
I20260809 06:57:10.795042 31138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:10.822291 31138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:10.823233 31138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:10.823499 31138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:10.824546 31138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:10.826180 31138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:10.826270 31138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:10.826352 31138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:10.826419 31138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:10.860981 31138 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:39019
I20260809 06:57:10.861073 31273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:39019 every 8 connection(s)
I20260809 06:57:10.862339 31138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:57:10.869817 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 31138
I20260809 06:57:10.870008 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:57:10.870586 11061 external_mini_cluster.cc:1428] Setting key 0db1398b78f09e3dac6cf4026ea74f64
I20260809 06:57:10.873507 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:43085
--builtin_ntp_servers=127.10.205.84:40235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 06:57:10.875321 31135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:10.864890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:44953 (local address 127.10.205.126:43085)
0809 06:57:10.865077 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:10.865082 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:10.866449 (+ 1367us) server_negotiation.cc:407] Connection header received
0809 06:57:10.868147 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:10.868151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:10.868219 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:10.868373 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:10.869564 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:10.870720 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:10.872568 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:10.872982 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:10.873115 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:10.874477 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:10.874485 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:10.874494 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:10.874510 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:10.874550 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:10.874561 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:10.874655 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:10.874887 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 06:57:10.875002 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:57:10.876454 31276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:10.865377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:43085 (local address 127.10.205.66:44953)
0809 06:57:10.866270 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:10.866312 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:10.867918 (+ 1606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:10.868546 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:10.868553 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:10.868650 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:10.869302 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:10.869343 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:10.870874 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:10.870878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:10.872407 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:10.872422 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:10.873214 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:10.873221 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:10.873457 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:10.874170 (+ 713us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:57:10.874172 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:10.874215 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:57:10.874291 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:10.874656 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:10.874668 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:10.874678 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 06:57:10.874879 (+ 201us) client_negotiation.cc:240] Negotiation successful
0809 06:57:10.875282 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":279,"threads_started":1}
I20260809 06:57:10.877907 31274 heartbeater.cc:347] Connected to a master server at 127.10.205.126:43085
I20260809 06:57:10.878242 31274 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:10.879140 31274 heartbeater.cc:511] Master 127.10.205.126:43085 requested a full tablet report, sending...
I20260809 06:57:10.880788 30939 ts_manager.cc:194] Registered new tserver with Master: befff58b978e45209c5d923034dd6ce9 (127.10.205.66:39019)
I20260809 06:57:10.882046 30939 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.205.66:44953
W20260809 06:57:11.210434 31277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:11.210739 31277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:11.210884 31277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:11.218250 31277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:11.218353 31277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:11.218492 31277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:57:11.227788 31277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:43085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:11.229230 31277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:11.231062 31277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:11.244637 31282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:11.244637 31283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:11.244623 31286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:11.245352 31277 server_base.cc:1034] running on GCE node
I20260809 06:57:11.245930 31277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:11.246902 31277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:11.248164 31277 hybrid_clock.cc:648] HybridClock initialized: now 1786258631248088 us; error 63 us; skew 500 ppm
I20260809 06:57:11.248507 31277 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:57:11.250803 31277 webserver.cc:460] Webserver started at http://127.10.205.67:42713/ using document root <none> and password file <none>
I20260809 06:57:11.251549 31277 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:11.251681 31277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:11.251996 31277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:11.254900 31277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "045099c3f9ea42e2bea9e73b89c68ee9"
format_stamp: "Formatted at 2026-08-09 06:57:11 on dist-test-slave-0b58"
server_key: "a510af6fbd3495623a9fe255e55f0e7a"
server_key_iv: "5c051b6f1b750620aada698a2f27a409"
server_key_version: "encryptionkey@0"
I20260809 06:57:11.255685 31277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "045099c3f9ea42e2bea9e73b89c68ee9"
format_stamp: "Formatted at 2026-08-09 06:57:11 on dist-test-slave-0b58"
server_key: "a510af6fbd3495623a9fe255e55f0e7a"
server_key_iv: "5c051b6f1b750620aada698a2f27a409"
server_key_version: "encryptionkey@0"
I20260809 06:57:11.261068 31277 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260809 06:57:11.264696 31292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:11.266098 31277 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:57:11.266345 31277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "045099c3f9ea42e2bea9e73b89c68ee9"
format_stamp: "Formatted at 2026-08-09 06:57:11 on dist-test-slave-0b58"
server_key: "a510af6fbd3495623a9fe255e55f0e7a"
server_key_iv: "5c051b6f1b750620aada698a2f27a409"
server_key_version: "encryptionkey@0"
I20260809 06:57:11.266640 31277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:11.284647 31277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:11.285554 31277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:11.285871 31277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:11.286939 31277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:11.288470 31277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:11.288578 31277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:11.288703 31277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:11.288794 31277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:11.322027 31277 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:32963
I20260809 06:57:11.322118 31410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:32963 every 8 connection(s)
I20260809 06:57:11.323403 31277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:57:11.328055 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 31277
I20260809 06:57:11.328235 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:57:11.328902 11061 external_mini_cluster.cc:1428] Setting key 8f3a8545971ebf4810b5c87fcf752450
I20260809 06:57:11.339381 31135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.327831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:46323 (local address 127.10.205.126:43085)
0809 06:57:11.332756 (+ 4925us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:11.332764 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:11.332802 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:57:11.332860 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:11.332877 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:11.332972 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:11.333107 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:11.334339 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.335122 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.336723 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.337152 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.337304 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.338571 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:11.338577 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:11.338582 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:11.338607 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:11.338637 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:11.338650 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:11.338744 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:11.338961 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 06:57:11.339053 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4768}
I20260809 06:57:11.340467 31413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.327359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:43085 (local address 127.10.205.67:46323)
0809 06:57:11.328800 (+ 1441us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:11.328858 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:11.331483 (+ 2625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:11.333358 (+ 1875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:11.333366 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:11.333456 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:11.334138 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:11.334159 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.335275 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.335282 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:11.336576 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:11.336588 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.337402 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.337409 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:11.337632 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.338268 (+ 636us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:57:11.338270 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:11.338306 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:57:11.338385 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:11.338746 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:11.338759 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:11.338768 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 06:57:11.338949 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 06:57:11.339326 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"spinlock_wait_cycles":18688,"thread_start_us":467,"threads_started":1}
I20260809 06:57:11.341889 31411 heartbeater.cc:347] Connected to a master server at 127.10.205.126:43085
I20260809 06:57:11.342208 31411 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:11.343119 31411 heartbeater.cc:511] Master 127.10.205.126:43085 requested a full tablet report, sending...
I20260809 06:57:11.344707 30939 ts_manager.cc:194] Registered new tserver with Master: 045099c3f9ea42e2bea9e73b89c68ee9 (127.10.205.67:32963)
I20260809 06:57:11.345506 30939 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.205.67:46323
I20260809 06:57:11.356103 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:57:11.366364 31135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.360645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60112 (local address 127.10.205.126:43085)
0809 06:57:11.360903 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:11.360909 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:11.361170 (+ 261us) server_negotiation.cc:407] Connection header received
0809 06:57:11.361293 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:11.361297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:11.361369 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:11.361448 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:11.361903 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.362593 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.363846 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.364239 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.364390 (+ 151us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.365530 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:11.365535 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:11.365538 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:11.365555 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:11.365585 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:11.365596 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:11.365710 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:11.365931 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 06:57:11.365974 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:57:11.370321 30939 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60112:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:57:11.377373 30939 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:57:11.404767 31133 heartbeater.cc:503] Master 127.10.205.126:43085 was elected leader, sending a full tablet report...
I20260809 06:57:11.421262 31425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.389528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:32963 (local address 127.0.0.1:40394)
0809 06:57:11.411565 (+ 22037us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:11.411589 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:11.411717 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:11.413574 (+ 1857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:11.413581 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:11.413626 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:11.414096 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:11.414114 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.415912 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.415917 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:11.418245 (+ 2328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:11.418258 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.420148 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.420155 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:11.420417 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.420470 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 06:57:11.420603 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 06:57:11.420813 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21866,"mutex_wait_us":4,"thread_start_us":21756,"threads_started":1}
I20260809 06:57:11.421576 31427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.390199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40394 (local address 127.10.205.67:32963)
0809 06:57:11.412626 (+ 22427us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:11.412636 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:11.412676 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:57:11.412784 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:11.412792 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:11.413054 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:11.413543 (+ 489us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:11.414360 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.415759 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.418468 (+ 2709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.419904 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.420079 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.420969 (+ 890us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:11.421044 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 06:57:11.421219 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22241,"thread_start_us":23027,"threads_started":1}
I20260809 06:57:11.421918 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.390784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39566 (local address 127.10.205.65:43693)
0809 06:57:11.409342 (+ 18558us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:11.409356 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:11.412960 (+ 3604us) server_negotiation.cc:407] Connection header received
0809 06:57:11.414123 (+ 1163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:11.414133 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:11.414366 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:11.414532 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:11.415325 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.416784 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.419155 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.420147 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.420281 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.420628 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:11.421357 (+ 729us) server_negotiation.cc:299] Negotiation successful
0809 06:57:11.421537 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18272,"thread_start_us":18586,"threads_started":1}
I20260809 06:57:11.421422 31426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.389299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:39019 (local address 127.0.0.1:34416)
0809 06:57:11.410446 (+ 21147us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:11.410521 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:11.410779 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:11.414008 (+ 3229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:11.414013 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:11.414045 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:11.414423 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:11.414432 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.416153 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.416159 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:11.418543 (+ 2384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:11.418561 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.420418 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.420425 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:11.420716 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.420760 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 06:57:11.420855 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 06:57:11.420998 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20713,"mutex_wait_us":28,"thread_start_us":23266,"threads_started":1}
I20260809 06:57:11.422299 31424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.389470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34416 (local address 127.10.205.66:39019)
0809 06:57:11.413432 (+ 23962us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:11.413441 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:11.413467 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:57:11.413564 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:11.413572 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:11.413786 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:11.414615 (+ 829us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:11.414865 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.416006 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.418751 (+ 2745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.420099 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.420226 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.421724 (+ 1498us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:11.421797 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 06:57:11.421950 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23785,"thread_start_us":23806,"threads_started":1}
I20260809 06:57:11.422320 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.390104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43693 (local address 127.0.0.1:39566)
0809 06:57:11.412834 (+ 22730us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:11.412852 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:11.413889 (+ 1037us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:11.414732 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:11.414739 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:11.414765 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:11.415123 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:11.415135 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.416951 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.416956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:11.418977 (+ 2021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:11.418987 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.420759 (+ 1772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.420765 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:11.420937 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.420971 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 06:57:11.421059 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 06:57:11.421197 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22604,"thread_start_us":21705,"threads_started":1}
I20260809 06:57:11.426612 31204 tablet_service.cc:1467] Processing CreateTablet for tablet 10d011f4d13c4557b606d67be2d7ab3f (DEFAULT_TABLE table=test-table [id=a8e0741a4c9744faae835284a28718bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:11.426615 31342 tablet_service.cc:1467] Processing CreateTablet for tablet 10d011f4d13c4557b606d67be2d7ab3f (DEFAULT_TABLE table=test-table [id=a8e0741a4c9744faae835284a28718bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:11.428211 31342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10d011f4d13c4557b606d67be2d7ab3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:11.428212 31204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10d011f4d13c4557b606d67be2d7ab3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:11.428790 31067 tablet_service.cc:1467] Processing CreateTablet for tablet 10d011f4d13c4557b606d67be2d7ab3f (DEFAULT_TABLE table=test-table [id=a8e0741a4c9744faae835284a28718bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:11.430109 31067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10d011f4d13c4557b606d67be2d7ab3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:11.442319 31429 tablet_bootstrap.cc:492] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6: Bootstrap starting.
I20260809 06:57:11.444964 31431 tablet_bootstrap.cc:492] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9: Bootstrap starting.
I20260809 06:57:11.445183 31430 tablet_bootstrap.cc:492] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9: Bootstrap starting.
I20260809 06:57:11.446374 31429 tablet_bootstrap.cc:654] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:11.447718 31429 log.cc:824] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:11.448848 31431 tablet_bootstrap.cc:654] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:11.449159 31430 tablet_bootstrap.cc:654] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:11.450089 31430 log.cc:824] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:11.450105 31431 log.cc:824] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:11.451198 31429 tablet_bootstrap.cc:492] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6: No bootstrap required, opened a new log
I20260809 06:57:11.451525 31429 ts_tablet_manager.cc:1397] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260809 06:57:11.452968 31431 tablet_bootstrap.cc:492] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9: No bootstrap required, opened a new log
I20260809 06:57:11.453142 31430 tablet_bootstrap.cc:492] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9: No bootstrap required, opened a new log
I20260809 06:57:11.453248 31431 ts_tablet_manager.cc:1397] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 06:57:11.453382 31430 ts_tablet_manager.cc:1397] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.001s
I20260809 06:57:11.461217 31431 raft_consensus.cc:348] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "befff58b978e45209c5d923034dd6ce9" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 39019 } } peers { permanent_uuid: "045099c3f9ea42e2bea9e73b89c68ee9" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 32963 } } peers { permanent_uuid: "760c52773c5846ea8bb261c9ed2875c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43693 } }
I20260809 06:57:11.461611 31431 raft_consensus.cc:374] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:11.461743 31431 raft_consensus.cc:729] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 045099c3f9ea42e2bea9e73b89c68ee9, State: Initialized, Role: FOLLOWER
I20260809 06:57:11.462379 31431 consensus_queue.cc:260] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "befff58b978e45209c5d923034dd6ce9" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 39019 } } peers { permanent_uuid: "045099c3f9ea42e2bea9e73b89c68ee9" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 32963 } } peers { permanent_uuid: "760c52773c5846ea8bb261c9ed2875c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43693 } }
I20260809 06:57:11.462357 31429 raft_consensus.cc:348] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "befff58b978e45209c5d923034dd6ce9" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 39019 } } peers { permanent_uuid: "045099c3f9ea42e2bea9e73b89c68ee9" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 32963 } } peers { permanent_uuid: "760c52773c5846ea8bb261c9ed2875c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43693 } }
I20260809 06:57:11.462814 31429 raft_consensus.cc:374] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:11.462963 31429 raft_consensus.cc:729] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 760c52773c5846ea8bb261c9ed2875c6, State: Initialized, Role: FOLLOWER
I20260809 06:57:11.463486 31411 heartbeater.cc:503] Master 127.10.205.126:43085 was elected leader, sending a full tablet report...
I20260809 06:57:11.463688 31429 consensus_queue.cc:260] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "befff58b978e45209c5d923034dd6ce9" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 39019 } } peers { permanent_uuid: "045099c3f9ea42e2bea9e73b89c68ee9" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 32963 } } peers { permanent_uuid: "760c52773c5846ea8bb261c9ed2875c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43693 } }
I20260809 06:57:11.463817 31430 raft_consensus.cc:348] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "befff58b978e45209c5d923034dd6ce9" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 39019 } } peers { permanent_uuid: "045099c3f9ea42e2bea9e73b89c68ee9" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 32963 } } peers { permanent_uuid: "760c52773c5846ea8bb261c9ed2875c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43693 } }
I20260809 06:57:11.464180 31431 ts_tablet_manager.cc:1428] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260809 06:57:11.464257 31430 raft_consensus.cc:374] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:11.464438 31430 raft_consensus.cc:729] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: befff58b978e45209c5d923034dd6ce9, State: Initialized, Role: FOLLOWER
I20260809 06:57:11.465071 31430 consensus_queue.cc:260] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "befff58b978e45209c5d923034dd6ce9" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 39019 } } peers { permanent_uuid: "045099c3f9ea42e2bea9e73b89c68ee9" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 32963 } } peers { permanent_uuid: "760c52773c5846ea8bb261c9ed2875c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43693 } }
I20260809 06:57:11.465961 31429 ts_tablet_manager.cc:1428] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260809 06:57:11.467000 31274 heartbeater.cc:503] Master 127.10.205.126:43085 was elected leader, sending a full tablet report...
I20260809 06:57:11.468616 31430 ts_tablet_manager.cc:1428] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9: Time spent starting tablet: real 0.015s user 0.009s sys 0.006s
I20260809 06:57:11.546310 31436 raft_consensus.cc:482] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:57:11.546590 31436 raft_consensus.cc:504] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "befff58b978e45209c5d923034dd6ce9" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 39019 } } peers { permanent_uuid: "045099c3f9ea42e2bea9e73b89c68ee9" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 32963 } } peers { permanent_uuid: "760c52773c5846ea8bb261c9ed2875c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43693 } }
I20260809 06:57:11.548300 31436 leader_election.cc:288] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers befff58b978e45209c5d923034dd6ce9 (127.10.205.66:39019), 045099c3f9ea42e2bea9e73b89c68ee9 (127.10.205.67:32963)
I20260809 06:57:11.555006 31424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.548694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:42241 (local address 127.10.205.66:39019)
0809 06:57:11.548920 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:11.548929 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:11.549722 (+ 793us) server_negotiation.cc:407] Connection header received
0809 06:57:11.549962 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:11.549967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:11.550047 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:11.550143 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:11.550728 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.551448 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.553416 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.554125 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.554291 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.554393 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:11.554636 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 06:57:11.554754 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:57:11.555151 31438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.548750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:39019 (local address 127.10.205.65:42241)
0809 06:57:11.549600 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:11.549620 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:11.549790 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:11.550165 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:11.550169 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:11.550192 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:11.550594 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:11.550607 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.551581 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.551586 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:11.553203 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:11.553215 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.554298 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.554304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:11.554469 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.554491 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 06:57:11.554597 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 06:57:11.554716 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"mutex_wait_us":100,"thread_start_us":525,"threads_started":1}
I20260809 06:57:11.555199 31427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.549004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:43501 (local address 127.10.205.67:32963)
0809 06:57:11.549251 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:11.549259 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:11.549792 (+ 533us) server_negotiation.cc:407] Connection header received
0809 06:57:11.550348 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:11.550356 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:11.550437 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:11.550539 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:11.551027 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.551714 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.553609 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.554358 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.554525 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.554591 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:11.554860 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 06:57:11.554978 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 06:57:11.555305 31439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.548809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:32963 (local address 127.10.205.65:43501)
0809 06:57:11.549709 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:11.549723 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:11.549828 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:11.550561 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:11.550564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:11.550586 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:11.550873 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:11.550881 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.551861 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.551871 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:11.553423 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:11.553436 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.554554 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.554560 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:11.554709 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.554731 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 06:57:11.554832 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 06:57:11.554949 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":798,"mutex_wait_us":41,"thread_start_us":482,"threads_started":1}
I20260809 06:57:11.556488 31225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10d011f4d13c4557b606d67be2d7ab3f" candidate_uuid: "760c52773c5846ea8bb261c9ed2875c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befff58b978e45209c5d923034dd6ce9" is_pre_election: true
I20260809 06:57:11.556479 31363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10d011f4d13c4557b606d67be2d7ab3f" candidate_uuid: "760c52773c5846ea8bb261c9ed2875c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045099c3f9ea42e2bea9e73b89c68ee9" is_pre_election: true
I20260809 06:57:11.557009 31363 raft_consensus.cc:2454] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 760c52773c5846ea8bb261c9ed2875c6 in term 0.
I20260809 06:57:11.557005 31225 raft_consensus.cc:2454] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 760c52773c5846ea8bb261c9ed2875c6 in term 0.
I20260809 06:57:11.557672 31017 leader_election.cc:302] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 760c52773c5846ea8bb261c9ed2875c6, befff58b978e45209c5d923034dd6ce9; no voters:
I20260809 06:57:11.558140 31436 raft_consensus.cc:2781] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:57:11.558313 31436 raft_consensus.cc:482] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:57:11.558411 31436 raft_consensus.cc:3037] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:11.560642 31436 raft_consensus.cc:504] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "befff58b978e45209c5d923034dd6ce9" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 39019 } } peers { permanent_uuid: "045099c3f9ea42e2bea9e73b89c68ee9" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 32963 } } peers { permanent_uuid: "760c52773c5846ea8bb261c9ed2875c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43693 } }
I20260809 06:57:11.561249 31436 leader_election.cc:288] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [CANDIDATE]: Term 1 election: Requested vote from peers befff58b978e45209c5d923034dd6ce9 (127.10.205.66:39019), 045099c3f9ea42e2bea9e73b89c68ee9 (127.10.205.67:32963)
I20260809 06:57:11.561700 31225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10d011f4d13c4557b606d67be2d7ab3f" candidate_uuid: "760c52773c5846ea8bb261c9ed2875c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "befff58b978e45209c5d923034dd6ce9"
I20260809 06:57:11.561730 31363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10d011f4d13c4557b606d67be2d7ab3f" candidate_uuid: "760c52773c5846ea8bb261c9ed2875c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045099c3f9ea42e2bea9e73b89c68ee9"
I20260809 06:57:11.561932 31225 raft_consensus.cc:3037] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:11.561932 31363 raft_consensus.cc:3037] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:11.565253 31225 raft_consensus.cc:2454] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 760c52773c5846ea8bb261c9ed2875c6 in term 1.
I20260809 06:57:11.565237 31363 raft_consensus.cc:2454] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 760c52773c5846ea8bb261c9ed2875c6 in term 1.
I20260809 06:57:11.565671 31017 leader_election.cc:302] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 760c52773c5846ea8bb261c9ed2875c6, befff58b978e45209c5d923034dd6ce9; no voters:
I20260809 06:57:11.565989 31436 raft_consensus.cc:2781] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:11.566547 31436 raft_consensus.cc:686] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 1 LEADER]: Becoming Leader. State: Replica: 760c52773c5846ea8bb261c9ed2875c6, State: Running, Role: LEADER
I20260809 06:57:11.567056 31436 consensus_queue.cc:237] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "befff58b978e45209c5d923034dd6ce9" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 39019 } } peers { permanent_uuid: "045099c3f9ea42e2bea9e73b89c68ee9" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 32963 } } peers { permanent_uuid: "760c52773c5846ea8bb261c9ed2875c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43693 } }
I20260809 06:57:11.572036 30939 catalog_manager.cc:5495] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 760c52773c5846ea8bb261c9ed2875c6 (127.10.205.65). New cstate: current_term: 1 leader_uuid: "760c52773c5846ea8bb261c9ed2875c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "befff58b978e45209c5d923034dd6ce9" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 39019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "045099c3f9ea42e2bea9e73b89c68ee9" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "760c52773c5846ea8bb261c9ed2875c6" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43693 } health_report { overall_health: HEALTHY } } }
W20260809 06:57:11.575939 31412 tablet.cc:2369] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:57:11.614439 31275 tablet.cc:2369] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:57:11.621286 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.615812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39574 (local address 127.10.205.65:43693)
0809 06:57:11.616028 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:11.616034 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:11.616133 (+ 99us) server_negotiation.cc:407] Connection header received
0809 06:57:11.616456 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:11.616461 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:11.616554 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:11.616678 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:57:11.617052 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.617754 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.619120 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.619520 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.619610 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.620090 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:57:11.620641 (+ 551us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:57:11.620772 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:11.620928 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 06:57:11.620991 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:57:11.629741 31363 raft_consensus.cc:1261] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9 [term 1 FOLLOWER]: Refusing update from remote peer 760c52773c5846ea8bb261c9ed2875c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:57:11.629683 31225 raft_consensus.cc:1261] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9 [term 1 FOLLOWER]: Refusing update from remote peer 760c52773c5846ea8bb261c9ed2875c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260809 06:57:11.630555 31134 tablet.cc:2369] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:57:11.630774 31440 consensus_queue.cc:1035] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "befff58b978e45209c5d923034dd6ce9" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 39019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:57:11.631176 31436 consensus_queue.cc:1035] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "045099c3f9ea42e2bea9e73b89c68ee9" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:57:11.643805 31444 mvcc.cc:205] Tried to move back new op lower bound from 7316515355144200192 to 7316515354902585344. Current Snapshot: MvccSnapshot[applied={T|T < 7316515355144200192}]
I20260809 06:57:11.648067 31445 mvcc.cc:205] Tried to move back new op lower bound from 7316515355144200192 to 7316515354902585344. Current Snapshot: MvccSnapshot[applied={T|T < 7316515355144200192}]
I20260809 06:57:11.662921 30938 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:57:11.663228 30938 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:57:11.666990 30938 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cd68011157a84e87a1a9ee8e55db709e: Sending DeleteTablet for 3 replicas of tablet 10d011f4d13c4557b606d67be2d7ab3f
I20260809 06:57:11.668205 31204 tablet_service.cc:1514] Processing DeleteTablet for tablet 10d011f4d13c4557b606d67be2d7ab3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:11 UTC) from {username='slave'} at 127.0.0.1:34416
I20260809 06:57:11.668228 31342 tablet_service.cc:1514] Processing DeleteTablet for tablet 10d011f4d13c4557b606d67be2d7ab3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:11 UTC) from {username='slave'} at 127.0.0.1:40394
I20260809 06:57:11.668478 31067 tablet_service.cc:1514] Processing DeleteTablet for tablet 10d011f4d13c4557b606d67be2d7ab3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:11 UTC) from {username='slave'} at 127.0.0.1:39566
I20260809 06:57:11.670796 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 31001
I20260809 06:57:11.681950 31453 tablet_replica.cc:330] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9: stopping tablet replica
I20260809 06:57:11.682646 31454 tablet_replica.cc:330] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9: stopping tablet replica
I20260809 06:57:11.683027 31455 tablet_replica.cc:330] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6: stopping tablet replica
I20260809 06:57:11.683194 31453 raft_consensus.cc:2229] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:57:11.683228 31454 raft_consensus.cc:2229] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:57:11.683565 31455 raft_consensus.cc:2229] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:57:11.683772 31453 raft_consensus.cc:2258] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:11.683828 31454 raft_consensus.cc:2258] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:11.684461 31455 raft_consensus.cc:2258] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:11.686381 31453 ts_tablet_manager.cc:1905] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:11.687143 31455 ts_tablet_manager.cc:1905] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:11.692655 31454 ts_tablet_manager.cc:1905] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:11.693583 31453 ts_tablet_manager.cc:1918] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:11.693740 31453 log.cc:1196] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/10d011f4d13c4557b606d67be2d7ab3f
I20260809 06:57:11.694274 31453 ts_tablet_manager.cc:1939] T 10d011f4d13c4557b606d67be2d7ab3f P befff58b978e45209c5d923034dd6ce9: Deleting consensus metadata
I20260809 06:57:11.695290 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.672062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39586 (local address 127.10.205.65:43693)
0809 06:57:11.672295 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:11.672304 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:11.685426 (+ 13122us) server_negotiation.cc:407] Connection header received
0809 06:57:11.685882 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:11.685889 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:11.685995 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:11.686080 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:11.686852 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.688104 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.690120 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.690846 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.690953 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.693252 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:11.693263 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:11.693280 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:11.694111 (+ 831us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:11.694193 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:11.694218 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:11.694326 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:11.694721 (+ 395us) server_negotiation.cc:299] Negotiation successful
0809 06:57:11.694855 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:57:11.696058 31128 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:11.696179 30923 catalog_manager.cc:4841] TS befff58b978e45209c5d923034dd6ce9 (127.10.205.66:39019): tablet 10d011f4d13c4557b606d67be2d7ab3f (table test-table [id=a8e0741a4c9744faae835284a28718bc]) successfully deleted
I20260809 06:57:11.695006 31455 ts_tablet_manager.cc:1918] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:11.696841 31455 log.cc:1196] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-0/wal/wals/10d011f4d13c4557b606d67be2d7ab3f
I20260809 06:57:11.703679 31454 ts_tablet_manager.cc:1918] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:11.703863 31454 log.cc:1196] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/10d011f4d13c4557b606d67be2d7ab3f
I20260809 06:57:11.704433 31454 ts_tablet_manager.cc:1939] T 10d011f4d13c4557b606d67be2d7ab3f P 045099c3f9ea42e2bea9e73b89c68ee9: Deleting consensus metadata
I20260809 06:57:11.706477 30926 catalog_manager.cc:4841] TS 045099c3f9ea42e2bea9e73b89c68ee9 (127.10.205.67:32963): tablet 10d011f4d13c4557b606d67be2d7ab3f (table test-table [id=a8e0741a4c9744faae835284a28718bc]) successfully deleted
I20260809 06:57:11.794898 31455 ts_tablet_manager.cc:1939] T 10d011f4d13c4557b606d67be2d7ab3f P 760c52773c5846ea8bb261c9ed2875c6: Deleting consensus metadata
I20260809 06:57:11.794994 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 31001
I20260809 06:57:11.816880 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 31138
W20260809 06:57:11.816890 30924 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.205.65:43693 (error 108)
I20260809 06:57:11.819139 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.818493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43693 (local address 127.0.0.1:39588)
0809 06:57:11.818768 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:11.818947 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 06:57:11.819410 30924 catalog_manager.cc:4584] TS 760c52773c5846ea8bb261c9ed2875c6 (127.10.205.65:43693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 10d011f4d13c4557b606d67be2d7ab3f: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43693: connect: Connection refused (error 111)
I20260809 06:57:11.829672 31424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.817733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34420 (local address 127.10.205.66:39019)
0809 06:57:11.817907 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:11.817912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:11.818151 (+ 239us) server_negotiation.cc:407] Connection header received
0809 06:57:11.818375 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:11.818381 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:11.818507 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:11.818617 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:11.819231 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.820498 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.822123 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.822550 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.822688 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.828134 (+ 5446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:11.828144 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:11.828158 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:11.828805 (+ 647us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:11.828856 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:11.828877 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:11.829018 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:11.829154 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 06:57:11.829289 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:57:11.830425 31268 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:11.873351 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.872870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43693 (local address 127.0.0.1:39592)
0809 06:57:11.873063 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:11.873162 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 06:57:11.874825 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.874412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43693 (local address 127.0.0.1:39600)
0809 06:57:11.874566 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:11.874651 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 06:57:11.935074 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 31138
I20260809 06:57:11.935422 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.934908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43693 (local address 127.0.0.1:39612)
0809 06:57:11.935129 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:11.935238 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 06:57:11.936861 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.936388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43693 (local address 127.0.0.1:39626)
0809 06:57:11.936588 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:11.936689 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 06:57:11.955452 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 31277
I20260809 06:57:11.961997 31427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:11.956227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40396 (local address 127.10.205.67:32963)
0809 06:57:11.956441 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:11.956446 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:11.956464 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:57:11.956604 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:11.956608 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:11.956696 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:11.956773 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:11.957132 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.957991 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.959199 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:11.959567 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:11.959657 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:11.960779 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:11.960787 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:11.960804 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:11.961401 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:11.961451 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:11.961469 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:11.961556 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:11.961675 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 06:57:11.961766 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 06:57:11.962652 31406 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:12.017596 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:12.016984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43693 (local address 127.0.0.1:39632)
0809 06:57:12.017259 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:12.017385 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260809 06:57:12.018780 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:12.018316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43693 (local address 127.0.0.1:39636)
0809 06:57:12.018531 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:12.018652 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260809 06:57:12.051306 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 31277
I20260809 06:57:12.070449 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 30907
I20260809 06:57:12.071524 30970 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:12.181427 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 30907
2026-08-09T06:57:12Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2951 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:12 dist-test-slave-0b58 krb5kdc[31464](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:12 dist-test-slave-0b58 krb5kdc[31464](info): set up 2 sockets
Aug 09 06:57:12 dist-test-slave-0b58 krb5kdc[31464](info): commencing operation
krb5kdc: starting...
W20260809 06:57:13.342299 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.006s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:13 dist-test-slave-0b58 krb5kdc[31464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258633, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:57:13.653611 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:39175
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:39175
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:13.998917 31479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:13.999215 31479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:13.999315 31479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:14.006738 31479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:14.006846 31479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:14.006892 31479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:14.006951 31479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:14.006995 31479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:14.016988 31479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:39175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:39175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:14.018311 31479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:14.019624 31479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:14.031633 31484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:14.031607 31485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:14.031900 31487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:14.032629 31479 server_base.cc:1034] running on GCE node
I20260809 06:57:14.033406 31479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:14.034929 31479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:14.036161 31479 hybrid_clock.cc:648] HybridClock initialized: now 1786258634036114 us; error 55 us; skew 500 ppm
I20260809 06:57:14.036537 31479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:14 dist-test-slave-0b58 krb5kdc[31464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258634, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:14.045205 31479 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:57:14.046802 31479 webserver.cc:460] Webserver started at http://127.10.205.126:38323/ using document root <none> and password file <none>
I20260809 06:57:14.047542 31479 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:14.047696 31479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:14.048022 31479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:14.051188 31479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "45eec4944f01403990eea897de038f98"
format_stamp: "Formatted at 2026-08-09 06:57:14 on dist-test-slave-0b58"
server_key: "0e159fcb82f2810addaf3bca9c44222f"
server_key_iv: "e60f70d12f5f54bd3fab4d9a11735bde"
server_key_version: "encryptionkey@0"
I20260809 06:57:14.051973 31479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "45eec4944f01403990eea897de038f98"
format_stamp: "Formatted at 2026-08-09 06:57:14 on dist-test-slave-0b58"
server_key: "0e159fcb82f2810addaf3bca9c44222f"
server_key_iv: "e60f70d12f5f54bd3fab4d9a11735bde"
server_key_version: "encryptionkey@0"
I20260809 06:57:14.057474 31479 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.002s
I20260809 06:57:14.060987 31494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:14.062299 31479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 06:57:14.062502 31479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "45eec4944f01403990eea897de038f98"
format_stamp: "Formatted at 2026-08-09 06:57:14 on dist-test-slave-0b58"
server_key: "0e159fcb82f2810addaf3bca9c44222f"
server_key_iv: "e60f70d12f5f54bd3fab4d9a11735bde"
server_key_version: "encryptionkey@0"
I20260809 06:57:14.062712 31479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:14.083848 31479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:14.087870 31479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:14.088174 31479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:14.107017 31479 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:39175
I20260809 06:57:14.107043 31547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:39175 every 8 connection(s)
I20260809 06:57:14.108430 31479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:14.112193 31548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:14.115710 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 31479
I20260809 06:57:14.115921 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:14.116528 11061 external_mini_cluster.cc:1428] Setting key 243fb5e1a8d8ab20f78511e0b66e0805
I20260809 06:57:14.125550 31548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98: Bootstrap starting.
I20260809 06:57:14.129484 31548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:14.130872 31548 log.cc:824] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:57:14 dist-test-slave-0b58 krb5kdc[31464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258633, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:14.134330 31548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98: No bootstrap required, opened a new log
I20260809 06:57:14.141100 31551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:14.118570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36454 (local address 127.10.205.126:39175)
0809 06:57:14.119417 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:14.119429 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:14.119472 (+ 43us) server_negotiation.cc:407] Connection header received
0809 06:57:14.121283 (+ 1811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:14.121307 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:14.121711 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:14.122043 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:14.123970 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:14.125360 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:14.127171 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:14.127877 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:14.128028 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:14.133580 (+ 5552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:14.133588 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:14.133603 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:14.133637 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:14.136930 (+ 3293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:14.137796 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:14.137803 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:14.137808 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:14.137979 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:14.138397 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:14.138400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:14.138402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:14.138901 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:14.139120 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:14.139603 (+ 483us) server_negotiation.cc:299] Negotiation successful
0809 06:57:14.139915 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":412,"threads_started":1}
I20260809 06:57:14.143669 31548 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45eec4944f01403990eea897de038f98" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39175 } }
I20260809 06:57:14.144157 31548 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:14.144311 31548 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45eec4944f01403990eea897de038f98, State: Initialized, Role: FOLLOWER
I20260809 06:57:14.144860 31548 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45eec4944f01403990eea897de038f98" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39175 } }
I20260809 06:57:14.145071 31548 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:14.145166 31548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:14.145282 31548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:14.147396 31548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45eec4944f01403990eea897de038f98" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39175 } }
I20260809 06:57:14.147954 31548 leader_election.cc:302] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45eec4944f01403990eea897de038f98; no voters:
I20260809 06:57:14.148654 31548 leader_election.cc:288] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:14.148795 31553 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:14.149560 31553 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [term 1 LEADER]: Becoming Leader. State: Replica: 45eec4944f01403990eea897de038f98, State: Running, Role: LEADER
I20260809 06:57:14.150102 31553 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45eec4944f01403990eea897de038f98" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39175 } }
I20260809 06:57:14.150846 31548 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:14.152710 31555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45eec4944f01403990eea897de038f98. Latest consensus state: current_term: 1 leader_uuid: "45eec4944f01403990eea897de038f98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45eec4944f01403990eea897de038f98" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39175 } } }
I20260809 06:57:14.153123 31555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:14.153740 31554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45eec4944f01403990eea897de038f98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45eec4944f01403990eea897de038f98" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39175 } } }
I20260809 06:57:14.154052 31554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:14.154955 31558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:14.160379 31558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:14.170150 31558 catalog_manager.cc:1347] Generated new cluster ID: 9cc031a5a66141cdbe8aa9bdfa3bef74
I20260809 06:57:14.170269 31558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:14.191895 31558 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:14.193799 31558 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:14.202165 31558 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98: Generated new TSK 0
I20260809 06:57:14.203186 31558 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.205.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
Entry for principal kudu/127.10.205.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab.
I20260809 06:57:14.275432 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39175
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:14.629123 31574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:14.629475 31574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:14.629580 31574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:14.636889 31574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:14.636998 31574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:14.637110 31574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:57:14.647249 31574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.65.keytab
--principal=kudu/127.10.205.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39175
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:14.648774 31574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:14.650115 31574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:14.663936 31580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:14.664033 31583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:14.664089 31581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:14.665663 31574 server_base.cc:1034] running on GCE node
I20260809 06:57:14.666301 31574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:14.667356 31574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:14.668556 31574 hybrid_clock.cc:648] HybridClock initialized: now 1786258634668504 us; error 49 us; skew 500 ppm
I20260809 06:57:14.668896 31574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:14 dist-test-slave-0b58 krb5kdc[31464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258634, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:14.672043 31574 init.cc:377] Logged in from keytab as kudu/127.10.205.65@KRBTEST.COM (short username kudu)
I20260809 06:57:14.673578 31574 webserver.cc:460] Webserver started at http://127.10.205.65:45009/ using document root <none> and password file <none>
I20260809 06:57:14.674258 31574 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:14.674360 31574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:14.674623 31574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:14.677596 31574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "55d3cc6d0d49499e9543d04b51a59e29"
format_stamp: "Formatted at 2026-08-09 06:57:14 on dist-test-slave-0b58"
server_key: "c79417c2700a7ada3aef9502c0d387a6"
server_key_iv: "a01d367cbc0410803aced3d04f127ccf"
server_key_version: "encryptionkey@0"
I20260809 06:57:14.678370 31574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "55d3cc6d0d49499e9543d04b51a59e29"
format_stamp: "Formatted at 2026-08-09 06:57:14 on dist-test-slave-0b58"
server_key: "c79417c2700a7ada3aef9502c0d387a6"
server_key_iv: "a01d367cbc0410803aced3d04f127ccf"
server_key_version: "encryptionkey@0"
I20260809 06:57:14.683707 31574 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:57:14.687150 31590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:14.688575 31574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:57:14.688757 31574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "55d3cc6d0d49499e9543d04b51a59e29"
format_stamp: "Formatted at 2026-08-09 06:57:14 on dist-test-slave-0b58"
server_key: "c79417c2700a7ada3aef9502c0d387a6"
server_key_iv: "a01d367cbc0410803aced3d04f127ccf"
server_key_version: "encryptionkey@0"
I20260809 06:57:14.688961 31574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:14.702147 31574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:14.706516 31574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:14.706825 31574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:14.707813 31574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:14.709604 31574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:14.709708 31574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:14.709841 31574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:14.709929 31574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:14.743397 31574 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:43595
I20260809 06:57:14.743458 31708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:43595 every 8 connection(s)
I20260809 06:57:14.744817 31574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:57:14.752985 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 31574
I20260809 06:57:14.753172 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:57:14.753722 11061 external_mini_cluster.cc:1428] Setting key edbe3de85a2050f010c5bf28eaf9ad8c
Aug 09 06:57:14 dist-test-slave-0b58 krb5kdc[31464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258634, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.65@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:14.766569 31711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:14.747347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:43537 (local address 127.10.205.126:39175)
0809 06:57:14.747864 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:14.747870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:14.748855 (+ 985us) server_negotiation.cc:407] Connection header received
0809 06:57:14.750726 (+ 1871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:14.750730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:14.750829 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:14.750942 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:14.752647 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:14.753519 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:14.755588 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:14.756089 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:14.756201 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:14.760594 (+ 4393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:14.760599 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:14.760602 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:14.760636 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:14.763246 (+ 2610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:14.764029 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:14.764034 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:14.764037 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:14.764160 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:14.764729 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:14.764733 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:14.764735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:14.765006 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:14.765170 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:14.765934 (+ 764us) server_negotiation.cc:299] Negotiation successful
0809 06:57:14.766190 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":233,"threads_started":1}
I20260809 06:57:14.767588 31712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:14.747890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39175 (local address 127.10.205.65:43537)
0809 06:57:14.748674 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:14.748713 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:14.750381 (+ 1668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:14.751197 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:14.751204 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:14.751827 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:14.752493 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:14.752513 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:14.753684 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:14.753689 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:14.755387 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:14.755401 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:14.756379 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:14.756389 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:14.756744 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:14.757512 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:57:14.757550 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:14.760351 (+ 2801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:14.763420 (+ 3069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:14.763429 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:14.763446 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:14.763886 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:14.764298 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:14.764303 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:14.764307 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:14.764598 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:14.765145 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:14.765153 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:14.765515 (+ 362us) client_negotiation.cc:769] Sending connection context
0809 06:57:14.765790 (+ 275us) client_negotiation.cc:240] Negotiation successful
0809 06:57:14.766361 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":337,"threads_started":1}
I20260809 06:57:14.769208 31709 heartbeater.cc:347] Connected to a master server at 127.10.205.126:39175
I20260809 06:57:14.769586 31709 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:14.770344 31709 heartbeater.cc:511] Master 127.10.205.126:39175 requested a full tablet report, sending...
I20260809 06:57:14.772642 31511 ts_manager.cc:194] Registered new tserver with Master: 55d3cc6d0d49499e9543d04b51a59e29 (127.10.205.65:43595)
I20260809 06:57:14.774150 31511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.65@KRBTEST.COM'} at 127.10.205.65:43537
WARNING: no policy specified for kudu/127.10.205.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
Entry for principal kudu/127.10.205.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab.
I20260809 06:57:14.823207 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39175
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:15.167095 31715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:15.167454 31715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:15.167627 31715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:15.175571 31715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:15.175722 31715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:15.175915 31715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:57:15.185842 31715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.66.keytab
--principal=kudu/127.10.205.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39175
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:15.187211 31715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:15.188634 31715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:15.202087 31720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:15.202181 31723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:15.202041 31721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:15.203128 31715 server_base.cc:1034] running on GCE node
I20260809 06:57:15.203683 31715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:15.204687 31715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:15.205936 31715 hybrid_clock.cc:648] HybridClock initialized: now 1786258635205888 us; error 39 us; skew 500 ppm
I20260809 06:57:15.206284 31715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:15 dist-test-slave-0b58 krb5kdc[31464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258635, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:15.209542 31715 init.cc:377] Logged in from keytab as kudu/127.10.205.66@KRBTEST.COM (short username kudu)
I20260809 06:57:15.211015 31715 webserver.cc:460] Webserver started at http://127.10.205.66:39439/ using document root <none> and password file <none>
I20260809 06:57:15.211723 31715 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:15.211874 31715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:15.212205 31715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:15.215098 31715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "5262a0e759514280803f49c412cdef0d"
format_stamp: "Formatted at 2026-08-09 06:57:15 on dist-test-slave-0b58"
server_key: "d55b3c409bee03c101d0225e18d8af00"
server_key_iv: "718a2aac2462eb149933ccd800c8efd0"
server_key_version: "encryptionkey@0"
I20260809 06:57:15.215878 31715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "5262a0e759514280803f49c412cdef0d"
format_stamp: "Formatted at 2026-08-09 06:57:15 on dist-test-slave-0b58"
server_key: "d55b3c409bee03c101d0225e18d8af00"
server_key_iv: "718a2aac2462eb149933ccd800c8efd0"
server_key_version: "encryptionkey@0"
I20260809 06:57:15.221083 31715 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260809 06:57:15.224550 31730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:15.225852 31715 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:57:15.226030 31715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "5262a0e759514280803f49c412cdef0d"
format_stamp: "Formatted at 2026-08-09 06:57:15 on dist-test-slave-0b58"
server_key: "d55b3c409bee03c101d0225e18d8af00"
server_key_iv: "718a2aac2462eb149933ccd800c8efd0"
server_key_version: "encryptionkey@0"
I20260809 06:57:15.226271 31715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:15.273974 31715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:15.278430 31715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:15.278733 31715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:15.279707 31715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:15.281136 31715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:15.281246 31715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:15.281404 31715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:15.281481 31715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:15.315196 31715 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:45111
I20260809 06:57:15.315244 31846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:45111 every 8 connection(s)
I20260809 06:57:15.316656 31715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:57:15.317056 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 31715
I20260809 06:57:15.317260 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:57:15.317920 11061 external_mini_cluster.cc:1428] Setting key ff71166ab1c429eb2bfa087432f2852a
Aug 09 06:57:15 dist-test-slave-0b58 krb5kdc[31464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258635, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.66@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:15.338985 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:15.319471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:57093 (local address 127.10.205.126:39175)
0809 06:57:15.319971 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:15.319978 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:15.321093 (+ 1115us) server_negotiation.cc:407] Connection header received
0809 06:57:15.322933 (+ 1840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:15.322938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:15.323025 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:15.323137 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:15.324707 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.325489 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.327061 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.327513 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.327656 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:15.332352 (+ 4696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:15.332360 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:15.332367 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:15.332411 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:15.335650 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:15.336398 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:15.336406 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:15.336413 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:15.336573 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:15.336984 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:15.336992 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:15.336998 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:15.337406 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:15.337570 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:15.338211 (+ 641us) server_negotiation.cc:299] Negotiation successful
0809 06:57:15.338463 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":251,"threads_started":1}
I20260809 06:57:15.339630 31850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:15.320128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39175 (local address 127.10.205.66:57093)
0809 06:57:15.320939 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:15.320983 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:15.322670 (+ 1687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:15.323380 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:15.323388 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:15.323899 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:15.324533 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:15.324552 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.325651 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.325655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:15.326917 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:15.326928 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.327770 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.327778 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:15.328007 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:15.328789 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:57:15.328838 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:15.332070 (+ 3232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:15.335788 (+ 3718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:15.335795 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:15.335809 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:15.336215 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:15.336683 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:15.336686 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:15.336688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:15.336867 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:15.337531 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:15.337537 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:15.337846 (+ 309us) client_negotiation.cc:769] Sending connection context
0809 06:57:15.338065 (+ 219us) client_negotiation.cc:240] Negotiation successful
0809 06:57:15.338460 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":332,"threads_started":1}
I20260809 06:57:15.341151 31847 heartbeater.cc:347] Connected to a master server at 127.10.205.126:39175
I20260809 06:57:15.341476 31847 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:15.342428 31847 heartbeater.cc:511] Master 127.10.205.126:39175 requested a full tablet report, sending...
I20260809 06:57:15.344131 31511 ts_manager.cc:194] Registered new tserver with Master: 5262a0e759514280803f49c412cdef0d (127.10.205.66:45111)
I20260809 06:57:15.344973 31511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.66@KRBTEST.COM'} at 127.10.205.66:57093
WARNING: no policy specified for kudu/127.10.205.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
Entry for principal kudu/127.10.205.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab.
I20260809 06:57:15.391541 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39175
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:15.734973 31854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:15.735268 31854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:15.735472 31854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:15.742841 31854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:15.743084 31854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:15.743305 31854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:57:15.753495 31854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.67.keytab
--principal=kudu/127.10.205.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:39175
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:15.754768 31854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:15.756084 31854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:15.769910 31861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:15.769994 31863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:15.769939 31860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:15.770787 31854 server_base.cc:1034] running on GCE node
I20260809 06:57:15.771400 31854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:15.772392 31854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:15.773614 31854 hybrid_clock.cc:648] HybridClock initialized: now 1786258635773577 us; error 52 us; skew 500 ppm
I20260809 06:57:15.773954 31854 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:15 dist-test-slave-0b58 krb5kdc[31464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258635, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:15.777105 31854 init.cc:377] Logged in from keytab as kudu/127.10.205.67@KRBTEST.COM (short username kudu)
I20260809 06:57:15.777899 31709 heartbeater.cc:503] Master 127.10.205.126:39175 was elected leader, sending a full tablet report...
I20260809 06:57:15.778852 31854 webserver.cc:460] Webserver started at http://127.10.205.67:45989/ using document root <none> and password file <none>
I20260809 06:57:15.779793 31854 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:15.779948 31854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:15.780352 31854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:15.783330 31854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "6022bbf43bb44305a19522526fc84eba"
format_stamp: "Formatted at 2026-08-09 06:57:15 on dist-test-slave-0b58"
server_key: "e992842ecf57984fcaad09e327a88745"
server_key_iv: "59532b084a7bf220939b3771760470ce"
server_key_version: "encryptionkey@0"
I20260809 06:57:15.784199 31854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "6022bbf43bb44305a19522526fc84eba"
format_stamp: "Formatted at 2026-08-09 06:57:15 on dist-test-slave-0b58"
server_key: "e992842ecf57984fcaad09e327a88745"
server_key_iv: "59532b084a7bf220939b3771760470ce"
server_key_version: "encryptionkey@0"
I20260809 06:57:15.789587 31854 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260809 06:57:15.793048 31871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:15.794370 31854 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 06:57:15.794548 31854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "6022bbf43bb44305a19522526fc84eba"
format_stamp: "Formatted at 2026-08-09 06:57:15 on dist-test-slave-0b58"
server_key: "e992842ecf57984fcaad09e327a88745"
server_key_iv: "59532b084a7bf220939b3771760470ce"
server_key_version: "encryptionkey@0"
I20260809 06:57:15.794740 31854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:15.833150 31854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:15.838101 31854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:15.838418 31854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:15.839474 31854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:15.840926 31854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:15.841009 31854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:15.841102 31854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:15.841146 31854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:15.874949 31854 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:37237
I20260809 06:57:15.874998 31988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:37237 every 8 connection(s)
I20260809 06:57:15.876401 31854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:57:15.885349 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 31854
I20260809 06:57:15.885542 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:57:15.885988 11061 external_mini_cluster.cc:1428] Setting key c3b8ae04e57db265e08723c90d82ad6f
Aug 09 06:57:15 dist-test-slave-0b58 krb5kdc[31464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258635, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.67@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:15.896891 31991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:15.878977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:56473 (local address 127.10.205.126:39175)
0809 06:57:15.879431 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:15.879436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:15.880513 (+ 1077us) server_negotiation.cc:407] Connection header received
0809 06:57:15.882377 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:15.882382 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:15.882486 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:15.882610 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:15.884108 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.885009 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.886874 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.887415 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.887564 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:15.891097 (+ 3533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:15.891103 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:15.891109 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:15.891155 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:15.893765 (+ 2610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:15.894485 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:15.894492 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:15.894495 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:15.894624 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:15.895081 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:15.895087 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:15.895090 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:15.895373 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:15.895544 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:15.896235 (+ 691us) server_negotiation.cc:299] Negotiation successful
0809 06:57:15.896495 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":235,"threads_started":1}
I20260809 06:57:15.897850 31992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:15.879600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:39175 (local address 127.10.205.67:56473)
0809 06:57:15.880346 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:15.880387 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:15.882099 (+ 1712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:15.882858 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:15.882865 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:15.883375 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:15.883928 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:15.883949 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.885166 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.885185 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:15.886726 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:15.886739 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.887673 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.887680 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:15.887925 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:15.888688 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:57:15.888711 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:15.890891 (+ 2180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:15.893907 (+ 3016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:15.893915 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:15.893931 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:15.894369 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:15.894743 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:15.894747 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:15.894751 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:15.894942 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:15.895509 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:15.895517 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:15.895854 (+ 337us) client_negotiation.cc:769] Sending connection context
0809 06:57:15.896135 (+ 281us) client_negotiation.cc:240] Negotiation successful
0809 06:57:15.896686 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":277,"threads_started":1}
I20260809 06:57:15.899298 31989 heartbeater.cc:347] Connected to a master server at 127.10.205.126:39175
I20260809 06:57:15.899654 31989 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:15.900489 31989 heartbeater.cc:511] Master 127.10.205.126:39175 requested a full tablet report, sending...
I20260809 06:57:15.901924 31511 ts_manager.cc:194] Registered new tserver with Master: 6022bbf43bb44305a19522526fc84eba (127.10.205.67:37237)
I20260809 06:57:15.902683 31511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.205.67@KRBTEST.COM'} at 127.10.205.67:56473
I20260809 06:57:15.913726 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:57:15.931067 31991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:15.918244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36466 (local address 127.10.205.126:39175)
0809 06:57:15.918501 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:15.918508 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:15.918865 (+ 357us) server_negotiation.cc:407] Connection header received
0809 06:57:15.918997 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:15.919002 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:15.919063 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:15.919143 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:15.920704 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.921431 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.922734 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.923116 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.923218 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:15.925710 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:15.925714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:15.925717 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:15.925747 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:15.928241 (+ 2494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:15.929130 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:15.929134 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:15.929136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:15.929255 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:15.929583 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:15.929586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:15.929588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:15.929905 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:15.930089 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:15.930531 (+ 442us) server_negotiation.cc:299] Negotiation successful
0809 06:57:15.930711 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 06:57:15.935201 31511 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36466:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:57:15.942256 31511 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:57:15.968765 32002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:15.954588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37237 (local address 127.0.0.1:54802)
0809 06:57:15.955491 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:15.955586 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:15.955803 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:15.957615 (+ 1812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:15.957626 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:15.957679 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:15.958163 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:15.958182 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.961184 (+ 3002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.961193 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:15.964407 (+ 3214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:15.964427 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.967726 (+ 3299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.967733 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:15.967952 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:15.968022 (+ 70us) client_negotiation.cc:769] Sending connection context
0809 06:57:15.968131 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 06:57:15.968358 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":340,"threads_started":1}
I20260809 06:57:15.970263 32003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:15.954881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54802 (local address 127.10.205.67:37237)
0809 06:57:15.956701 (+ 1820us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:15.956713 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:15.956839 (+ 126us) server_negotiation.cc:407] Connection header received
0809 06:57:15.956954 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:15.956963 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:15.957261 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:15.958463 (+ 1202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:15.958798 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.960974 (+ 2176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.965787 (+ 4813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.967482 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.969321 (+ 1839us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:15.969591 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:15.969682 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 06:57:15.969883 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1562,"thread_start_us":1383,"threads_started":1}
I20260809 06:57:15.974557 31919 tablet_service.cc:1467] Processing CreateTablet for tablet bed1feb78815463da4986ffd02605007 (DEFAULT_TABLE table=test-table [id=1acee81b2d57477cbc065badbe7f8462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:15.976131 31919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed1feb78815463da4986ffd02605007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:15.977959 32005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:15.955331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43595 (local address 127.0.0.1:42510)
0809 06:57:15.966252 (+ 10921us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:15.966281 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:15.966421 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:15.969315 (+ 2894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:15.969320 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:15.969346 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:15.969724 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:15.969737 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.973189 (+ 3452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.973198 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:15.975098 (+ 1900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:15.975114 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.977046 (+ 1932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.977053 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:15.977229 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:15.977278 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 06:57:15.977388 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 06:57:15.977521 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10750,"mutex_wait_us":51,"thread_start_us":15321,"threads_started":1}
I20260809 06:57:15.977994 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:15.955970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42510 (local address 127.10.205.65:43595)
0809 06:57:15.964854 (+ 8884us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:15.964863 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:15.966761 (+ 1898us) server_negotiation.cc:407] Connection header received
0809 06:57:15.966926 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:15.966934 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:15.967205 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:15.967420 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:15.969960 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.973048 (+ 3088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.975289 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.976819 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.976962 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:15.977196 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:15.977449 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 06:57:15.977624 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8667,"thread_start_us":8494,"threads_started":1}
I20260809 06:57:15.978617 32002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:15.955826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:45111 (local address 127.0.0.1:35992)
0809 06:57:15.969017 (+ 13191us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:15.969035 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:15.969135 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:15.971815 (+ 2680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:15.971826 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:15.971853 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:15.972128 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:15.972143 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.974057 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.974063 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:15.975953 (+ 1890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:15.975970 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.977797 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.977804 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:15.978010 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:15.978053 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 06:57:15.978131 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 06:57:15.978283 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13093,"mutex_wait_us":1,"thread_start_us":11817,"threads_started":1}
I20260809 06:57:15.979688 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:15.956400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35992 (local address 127.10.205.66:45111)
0809 06:57:15.971145 (+ 14745us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:15.971155 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:15.971185 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:57:15.971283 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:15.971292 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:15.971579 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:15.971809 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:15.972379 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.973888 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.976140 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:15.977599 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:15.979024 (+ 1425us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:15.979180 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:15.979229 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 06:57:15.979354 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14589,"thread_start_us":14471,"threads_started":1}
I20260809 06:57:15.981966 31640 tablet_service.cc:1467] Processing CreateTablet for tablet bed1feb78815463da4986ffd02605007 (DEFAULT_TABLE table=test-table [id=1acee81b2d57477cbc065badbe7f8462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:15.983209 31640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed1feb78815463da4986ffd02605007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:15.983410 31780 tablet_service.cc:1467] Processing CreateTablet for tablet bed1feb78815463da4986ffd02605007 (DEFAULT_TABLE table=test-table [id=1acee81b2d57477cbc065badbe7f8462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:15.984853 31780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed1feb78815463da4986ffd02605007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:15.992743 32008 tablet_bootstrap.cc:492] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba: Bootstrap starting.
I20260809 06:57:15.995311 32009 tablet_bootstrap.cc:492] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29: Bootstrap starting.
I20260809 06:57:15.996560 32008 tablet_bootstrap.cc:654] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:15.997855 32008 log.cc:824] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:15.998919 32009 tablet_bootstrap.cc:654] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:16.000516 32009 log.cc:824] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:16.002444 32011 tablet_bootstrap.cc:492] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d: Bootstrap starting.
I20260809 06:57:16.003896 32009 tablet_bootstrap.cc:492] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29: No bootstrap required, opened a new log
I20260809 06:57:16.004163 32009 ts_tablet_manager.cc:1397] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260809 06:57:16.005321 32011 tablet_bootstrap.cc:654] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:16.006284 32011 log.cc:824] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:16.008689 32008 tablet_bootstrap.cc:492] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba: No bootstrap required, opened a new log
I20260809 06:57:16.008963 32008 ts_tablet_manager.cc:1397] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.003s
I20260809 06:57:16.009771 32011 tablet_bootstrap.cc:492] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d: No bootstrap required, opened a new log
I20260809 06:57:16.010031 32011 ts_tablet_manager.cc:1397] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260809 06:57:16.014088 32009 raft_consensus.cc:348] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6022bbf43bb44305a19522526fc84eba" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37237 } } peers { permanent_uuid: "5262a0e759514280803f49c412cdef0d" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45111 } } peers { permanent_uuid: "55d3cc6d0d49499e9543d04b51a59e29" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43595 } }
I20260809 06:57:16.014551 32009 raft_consensus.cc:374] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:16.014650 32009 raft_consensus.cc:729] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55d3cc6d0d49499e9543d04b51a59e29, State: Initialized, Role: FOLLOWER
I20260809 06:57:16.015332 32009 consensus_queue.cc:260] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6022bbf43bb44305a19522526fc84eba" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37237 } } peers { permanent_uuid: "5262a0e759514280803f49c412cdef0d" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45111 } } peers { permanent_uuid: "55d3cc6d0d49499e9543d04b51a59e29" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43595 } }
I20260809 06:57:16.016732 32008 raft_consensus.cc:348] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6022bbf43bb44305a19522526fc84eba" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37237 } } peers { permanent_uuid: "5262a0e759514280803f49c412cdef0d" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45111 } } peers { permanent_uuid: "55d3cc6d0d49499e9543d04b51a59e29" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43595 } }
I20260809 06:57:16.017143 32008 raft_consensus.cc:374] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:16.017172 32009 ts_tablet_manager.cc:1428] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29: Time spent starting tablet: real 0.013s user 0.005s sys 0.009s
I20260809 06:57:16.017241 32008 raft_consensus.cc:729] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6022bbf43bb44305a19522526fc84eba, State: Initialized, Role: FOLLOWER
I20260809 06:57:16.017813 32008 consensus_queue.cc:260] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6022bbf43bb44305a19522526fc84eba" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37237 } } peers { permanent_uuid: "5262a0e759514280803f49c412cdef0d" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45111 } } peers { permanent_uuid: "55d3cc6d0d49499e9543d04b51a59e29" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43595 } }
I20260809 06:57:16.020069 31989 heartbeater.cc:503] Master 127.10.205.126:39175 was elected leader, sending a full tablet report...
I20260809 06:57:16.020846 32008 ts_tablet_manager.cc:1428] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260809 06:57:16.021775 32011 raft_consensus.cc:348] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6022bbf43bb44305a19522526fc84eba" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37237 } } peers { permanent_uuid: "5262a0e759514280803f49c412cdef0d" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45111 } } peers { permanent_uuid: "55d3cc6d0d49499e9543d04b51a59e29" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43595 } }
I20260809 06:57:16.022287 32011 raft_consensus.cc:374] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:16.022426 32011 raft_consensus.cc:729] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5262a0e759514280803f49c412cdef0d, State: Initialized, Role: FOLLOWER
I20260809 06:57:16.022997 32011 consensus_queue.cc:260] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6022bbf43bb44305a19522526fc84eba" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37237 } } peers { permanent_uuid: "5262a0e759514280803f49c412cdef0d" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45111 } } peers { permanent_uuid: "55d3cc6d0d49499e9543d04b51a59e29" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43595 } }
I20260809 06:57:16.024412 31847 heartbeater.cc:503] Master 127.10.205.126:39175 was elected leader, sending a full tablet report...
I20260809 06:57:16.024940 32011 ts_tablet_manager.cc:1428] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d: Time spent starting tablet: real 0.015s user 0.005s sys 0.010s
W20260809 06:57:16.068936 31848 tablet.cc:2369] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:57:16.128125 31990 tablet.cc:2369] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:57:16.247556 31710 tablet.cc:2369] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:57:16.271368 32014 raft_consensus.cc:482] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:57:16.271698 32014 raft_consensus.cc:504] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6022bbf43bb44305a19522526fc84eba" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37237 } } peers { permanent_uuid: "5262a0e759514280803f49c412cdef0d" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45111 } } peers { permanent_uuid: "55d3cc6d0d49499e9543d04b51a59e29" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43595 } }
I20260809 06:57:16.273357 32014 leader_election.cc:288] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6022bbf43bb44305a19522526fc84eba (127.10.205.67:37237), 5262a0e759514280803f49c412cdef0d (127.10.205.66:45111)
I20260809 06:57:16.280031 32003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.273834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:37883 (local address 127.10.205.67:37237)
0809 06:57:16.274018 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:16.274023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:16.274660 (+ 637us) server_negotiation.cc:407] Connection header received
0809 06:57:16.274940 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:16.274948 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:16.275034 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:16.275132 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:16.275782 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.276551 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.278287 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.279098 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.279300 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:16.279377 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:16.279647 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 06:57:16.279784 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:57:16.280108 32017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.273810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:37237 (local address 127.10.205.65:37883)
0809 06:57:16.274549 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:16.274571 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:16.274722 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:16.275192 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:16.275197 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:16.275228 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:16.275582 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:16.275591 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.276685 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.276695 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:16.278125 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:16.278137 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.279321 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.279327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:16.279482 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:16.279506 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:57:16.279609 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 06:57:16.279737 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":397,"threads_started":1}
I20260809 06:57:16.280800 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.274870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:46973 (local address 127.10.205.66:45111)
0809 06:57:16.275073 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:16.275081 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:16.275490 (+ 409us) server_negotiation.cc:407] Connection header received
0809 06:57:16.275699 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:16.275707 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:16.275803 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:16.275901 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:16.276485 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.277167 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.278901 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.279700 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.279900 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:16.279978 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:16.280387 (+ 409us) server_negotiation.cc:299] Negotiation successful
0809 06:57:16.280532 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:57:16.281347 32018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.274699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:45111 (local address 127.10.205.65:46973)
0809 06:57:16.275370 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:16.275391 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:16.275553 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:16.275919 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:16.275923 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:16.275945 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:16.276334 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:16.276345 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.277336 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.277341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:16.278735 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:16.278748 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.279943 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.279950 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:16.280089 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:16.280139 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 06:57:16.281014 (+ 875us) client_negotiation.cc:240] Negotiation successful
0809 06:57:16.281125 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":361,"threads_started":1}
I20260809 06:57:16.281486 31941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bed1feb78815463da4986ffd02605007" candidate_uuid: "55d3cc6d0d49499e9543d04b51a59e29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6022bbf43bb44305a19522526fc84eba" is_pre_election: true
I20260809 06:57:16.282142 31941 raft_consensus.cc:2454] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55d3cc6d0d49499e9543d04b51a59e29 in term 0.
I20260809 06:57:16.282363 31801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bed1feb78815463da4986ffd02605007" candidate_uuid: "55d3cc6d0d49499e9543d04b51a59e29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5262a0e759514280803f49c412cdef0d" is_pre_election: true
I20260809 06:57:16.282855 31592 leader_election.cc:302] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55d3cc6d0d49499e9543d04b51a59e29, 6022bbf43bb44305a19522526fc84eba; no voters:
I20260809 06:57:16.282919 31801 raft_consensus.cc:2454] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55d3cc6d0d49499e9543d04b51a59e29 in term 0.
I20260809 06:57:16.283274 32014 raft_consensus.cc:2781] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:57:16.283449 32014 raft_consensus.cc:482] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:57:16.283594 32014 raft_consensus.cc:3037] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:16.285888 32014 raft_consensus.cc:504] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6022bbf43bb44305a19522526fc84eba" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37237 } } peers { permanent_uuid: "5262a0e759514280803f49c412cdef0d" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45111 } } peers { permanent_uuid: "55d3cc6d0d49499e9543d04b51a59e29" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43595 } }
I20260809 06:57:16.286491 32014 leader_election.cc:288] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [CANDIDATE]: Term 1 election: Requested vote from peers 6022bbf43bb44305a19522526fc84eba (127.10.205.67:37237), 5262a0e759514280803f49c412cdef0d (127.10.205.66:45111)
I20260809 06:57:16.286990 31941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bed1feb78815463da4986ffd02605007" candidate_uuid: "55d3cc6d0d49499e9543d04b51a59e29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6022bbf43bb44305a19522526fc84eba"
I20260809 06:57:16.287071 31801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bed1feb78815463da4986ffd02605007" candidate_uuid: "55d3cc6d0d49499e9543d04b51a59e29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5262a0e759514280803f49c412cdef0d"
I20260809 06:57:16.287217 31941 raft_consensus.cc:3037] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:16.287251 31801 raft_consensus.cc:3037] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:16.290395 31941 raft_consensus.cc:2454] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55d3cc6d0d49499e9543d04b51a59e29 in term 1.
I20260809 06:57:16.290392 31801 raft_consensus.cc:2454] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55d3cc6d0d49499e9543d04b51a59e29 in term 1.
I20260809 06:57:16.290831 31592 leader_election.cc:302] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5262a0e759514280803f49c412cdef0d, 55d3cc6d0d49499e9543d04b51a59e29; no voters:
I20260809 06:57:16.291100 32014 raft_consensus.cc:2781] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:16.291615 32014 raft_consensus.cc:686] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 1 LEADER]: Becoming Leader. State: Replica: 55d3cc6d0d49499e9543d04b51a59e29, State: Running, Role: LEADER
I20260809 06:57:16.292093 32014 consensus_queue.cc:237] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6022bbf43bb44305a19522526fc84eba" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37237 } } peers { permanent_uuid: "5262a0e759514280803f49c412cdef0d" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45111 } } peers { permanent_uuid: "55d3cc6d0d49499e9543d04b51a59e29" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43595 } }
I20260809 06:57:16.297020 31510 catalog_manager.cc:5495] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55d3cc6d0d49499e9543d04b51a59e29 (127.10.205.65). New cstate: current_term: 1 leader_uuid: "55d3cc6d0d49499e9543d04b51a59e29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6022bbf43bb44305a19522526fc84eba" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5262a0e759514280803f49c412cdef0d" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55d3cc6d0d49499e9543d04b51a59e29" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43595 } health_report { overall_health: HEALTHY } } }
I20260809 06:57:16.348189 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.342207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42516 (local address 127.10.205.65:43595)
0809 06:57:16.342426 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:16.342431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:16.342470 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:57:16.342808 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:16.342814 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:16.342933 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:16.343116 (+ 183us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:57:16.343516 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.344556 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.345913 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.346364 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.346502 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:16.347043 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:57:16.347594 (+ 551us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:57:16.347768 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:16.347823 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 06:57:16.347909 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 06:57:16.356709 31801 raft_consensus.cc:1261] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d [term 1 FOLLOWER]: Refusing update from remote peer 55d3cc6d0d49499e9543d04b51a59e29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:57:16.356709 31941 raft_consensus.cc:1261] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba [term 1 FOLLOWER]: Refusing update from remote peer 55d3cc6d0d49499e9543d04b51a59e29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:57:16.357707 32019 consensus_queue.cc:1035] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6022bbf43bb44305a19522526fc84eba" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 37237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:57:16.358045 32014 consensus_queue.cc:1035] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5262a0e759514280803f49c412cdef0d" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 45111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:57:16.370390 32022 mvcc.cc:205] Tried to move back new op lower bound from 7316515374506242048 to 7316515374256857088. Current Snapshot: MvccSnapshot[applied={T|T < 7316515374506242048}]
I20260809 06:57:16.384096 31510 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36466:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:57:16.384429 31510 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36466:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:57:16.387926 31510 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 45eec4944f01403990eea897de038f98: Sending DeleteTablet for 3 replicas of tablet bed1feb78815463da4986ffd02605007
I20260809 06:57:16.389326 31640 tablet_service.cc:1514] Processing DeleteTablet for tablet bed1feb78815463da4986ffd02605007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:16 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:42510
I20260809 06:57:16.389366 31919 tablet_service.cc:1514] Processing DeleteTablet for tablet bed1feb78815463da4986ffd02605007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:16 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:54802
I20260809 06:57:16.389573 31780 tablet_service.cc:1514] Processing DeleteTablet for tablet bed1feb78815463da4986ffd02605007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:16 UTC) from {username='kudu', principal='kudu/127.10.205.126@KRBTEST.COM'} at 127.0.0.1:35992
I20260809 06:57:16.391449 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 31574
I20260809 06:57:16.400969 32035 tablet_replica.cc:330] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d: stopping tablet replica
I20260809 06:57:16.401547 32035 raft_consensus.cc:2229] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:57:16.402182 32035 raft_consensus.cc:2258] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:16.407209 32035 ts_tablet_manager.cc:1905] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:16.408430 32033 tablet_replica.cc:330] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba: stopping tablet replica
I20260809 06:57:16.408851 32033 raft_consensus.cc:2229] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:57:16.409320 32033 raft_consensus.cc:2258] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:16.408233 32034 tablet_replica.cc:330] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29: stopping tablet replica
I20260809 06:57:16.409963 32034 raft_consensus.cc:2229] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:57:16.410580 32034 raft_consensus.cc:2258] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 09 06:57:16 dist-test-slave-0b58 krb5kdc[31464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258633, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.65@KRBTEST.COM
I20260809 06:57:16.414469 32035 ts_tablet_manager.cc:1918] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:16.414623 32035 log.cc:1196] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/bed1feb78815463da4986ffd02605007
I20260809 06:57:16.414604 32034 ts_tablet_manager.cc:1905] T bed1feb78815463da4986ffd02605007 P 55d3cc6d0d49499e9543d04b51a59e29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:16.415155 32035 ts_tablet_manager.cc:1939] T bed1feb78815463da4986ffd02605007 P 5262a0e759514280803f49c412cdef0d: Deleting consensus metadata
I20260809 06:57:16.415588 32033 ts_tablet_manager.cc:1905] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:16.417155 31496 catalog_manager.cc:4841] TS 5262a0e759514280803f49c412cdef0d (127.10.205.66:45111): tablet bed1feb78815463da4986ffd02605007 (table test-table [id=1acee81b2d57477cbc065badbe7f8462]) successfully deleted
I20260809 06:57:16.420814 32033 ts_tablet_manager.cc:1918] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:16.421001 32033 log.cc:1196] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/bed1feb78815463da4986ffd02605007
I20260809 06:57:16.421515 32033 ts_tablet_manager.cc:1939] T bed1feb78815463da4986ffd02605007 P 6022bbf43bb44305a19522526fc84eba: Deleting consensus metadata
I20260809 06:57:16.422091 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.392477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42522 (local address 127.10.205.65:43595)
0809 06:57:16.392644 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:16.392650 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:16.397928 (+ 5278us) server_negotiation.cc:407] Connection header received
0809 06:57:16.398176 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:16.398181 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:16.398289 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:16.398396 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:16.402601 (+ 4205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.403813 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.405736 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.406502 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.406600 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:16.412754 (+ 6154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:16.412773 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:16.412790 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:16.412851 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:16.417790 (+ 4939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:16.418726 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:16.418735 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:16.418738 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:16.418979 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:16.419481 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:16.419487 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:16.419492 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:16.419976 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:16.420306 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:16.421020 (+ 714us) server_negotiation.cc:299] Negotiation successful
0809 06:57:16.421657 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:57:16.423302 31496 catalog_manager.cc:4841] TS 6022bbf43bb44305a19522526fc84eba (127.10.205.67:37237): tablet bed1feb78815463da4986ffd02605007 (table test-table [id=1acee81b2d57477cbc065badbe7f8462]) successfully deleted
I20260809 06:57:16.424569 31704 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:16.525000 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 31574
I20260809 06:57:16.547227 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 31715
W20260809 06:57:16.547236 31495 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.205.65:43595 (error 108)
I20260809 06:57:16.549496 32039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.548707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43595 (local address 127.0.0.1:42528)
0809 06:57:16.549214 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:16.549329 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":261,"threads_started":1}
W20260809 06:57:16.549788 31495 catalog_manager.cc:4584] TS 55d3cc6d0d49499e9543d04b51a59e29 (127.10.205.65:43595): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bed1feb78815463da4986ffd02605007: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43595: connect: Connection refused (error 111)
Aug 09 06:57:16 dist-test-slave-0b58 krb5kdc[31464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258633, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.66@KRBTEST.COM
I20260809 06:57:16.563027 32007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.548142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36004 (local address 127.10.205.66:45111)
0809 06:57:16.548409 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:16.548416 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:16.548577 (+ 161us) server_negotiation.cc:407] Connection header received
0809 06:57:16.548767 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:16.548771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:16.548835 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:16.548955 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:16.550440 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.551185 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.552677 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.553115 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.553216 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:16.557656 (+ 4440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:16.557672 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:16.557688 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:16.557730 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:16.560452 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:16.561120 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:16.561127 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:16.561129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:16.561281 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:16.561608 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:16.561611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:16.561613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:16.562003 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:16.562212 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:16.562475 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 06:57:16.562640 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 06:57:16.563673 31841 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:16.603576 32039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.603102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43595 (local address 127.0.0.1:42536)
0809 06:57:16.603324 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:16.603416 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260809 06:57:16.604720 32039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.604361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43595 (local address 127.0.0.1:42544)
0809 06:57:16.604507 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:16.604578 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 06:57:16.655112 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 31715
I20260809 06:57:16.665359 32039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.664759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43595 (local address 127.0.0.1:42556)
0809 06:57:16.665008 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:16.665133 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 06:57:16.666590 32039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.666042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43595 (local address 127.0.0.1:42562)
0809 06:57:16.666263 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:16.666375 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 06:57:16.675590 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 31854
Aug 09 06:57:16 dist-test-slave-0b58 krb5kdc[31464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258633, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.67@KRBTEST.COM
I20260809 06:57:16.690902 32003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.676468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54806 (local address 127.10.205.67:37237)
0809 06:57:16.676662 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:16.676666 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:16.676685 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:57:16.676842 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:16.676846 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:16.676909 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:16.676990 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:16.678313 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.679036 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.680522 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:16.680913 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:16.681014 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:16.685567 (+ 4553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:16.685583 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:16.685600 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:16.685635 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:16.688394 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:16.689073 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:16.689080 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:16.689082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:16.689221 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:16.689536 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:16.689539 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:16.689541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:16.689890 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:16.690122 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:16.690369 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 06:57:16.690538 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 06:57:16.691648 31984 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:16.747200 32039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.746704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43595 (local address 127.0.0.1:42578)
0809 06:57:16.746962 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:16.747053 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260809 06:57:16.748392 32039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:16.747885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43595 (local address 127.0.0.1:42588)
0809 06:57:16.748093 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:16.748170 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260809 06:57:16.780704 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 31854
I20260809 06:57:16.800158 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 31479
I20260809 06:57:16.801409 31543 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:16.915621 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 31479
2026-08-09T06:57:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4734 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T06:57:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:16Z Disabled control of system clock
I20260809 06:57:17.011420 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44957
--webserver_interface=127.10.205.126
--webserver_port=0
--builtin_ntp_servers=127.10.205.84:46469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:44957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 06:57:17.357858 32046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:17.358161 32046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:17.358295 32046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:17.365804 32046 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:17.365950 32046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:17.366017 32046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:17.366145 32046 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:17.366247 32046 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:17.375792 32046 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:44957
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:44957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:17.377183 32046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:17.379067 32046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:17.390926 32052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:17.390977 32053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:17.391003 32055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:17.391834 32046 server_base.cc:1034] running on GCE node
I20260809 06:57:17.392599 32046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:17.393916 32046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:17.395123 32046 hybrid_clock.cc:648] HybridClock initialized: now 1786258637395073 us; error 33 us; skew 500 ppm
I20260809 06:57:17.395437 32046 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:57:17.397663 32046 webserver.cc:460] Webserver started at http://127.10.205.126:38487/ using document root <none> and password file <none>
I20260809 06:57:17.398296 32046 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:17.398384 32046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:17.398644 32046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:17.401592 32046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "c2886a76d68f41dbb759914478efedcb"
format_stamp: "Formatted at 2026-08-09 06:57:17 on dist-test-slave-0b58"
server_key: "9e7cfd9227500fcdf4f4e4fed3540845"
server_key_iv: "4d2b6a5dcb1e0f53fe9ef5d7579f938a"
server_key_version: "encryptionkey@0"
I20260809 06:57:17.402371 32046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "c2886a76d68f41dbb759914478efedcb"
format_stamp: "Formatted at 2026-08-09 06:57:17 on dist-test-slave-0b58"
server_key: "9e7cfd9227500fcdf4f4e4fed3540845"
server_key_iv: "4d2b6a5dcb1e0f53fe9ef5d7579f938a"
server_key_version: "encryptionkey@0"
I20260809 06:57:17.407260 32046 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:57:17.410876 32061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:17.412315 32046 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:57:17.412524 32046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "c2886a76d68f41dbb759914478efedcb"
format_stamp: "Formatted at 2026-08-09 06:57:17 on dist-test-slave-0b58"
server_key: "9e7cfd9227500fcdf4f4e4fed3540845"
server_key_iv: "4d2b6a5dcb1e0f53fe9ef5d7579f938a"
server_key_version: "encryptionkey@0"
I20260809 06:57:17.412752 32046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:17.433910 32046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:17.434798 32046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:17.435099 32046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:17.454335 32046 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:44957
I20260809 06:57:17.454344 32113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:44957 every 8 connection(s)
I20260809 06:57:17.455752 32046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:17.459586 32114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:17.461402 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 32046
I20260809 06:57:17.461588 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:17.462086 11061 external_mini_cluster.cc:1428] Setting key b456d7b80d7a25e7dedeced4f97e226f
I20260809 06:57:17.474560 32114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb: Bootstrap starting.
I20260809 06:57:17.477144 32117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:17.464073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56064 (local address 127.10.205.126:44957)
0809 06:57:17.465304 (+ 1231us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:17.465320 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:17.465387 (+ 67us) server_negotiation.cc:407] Connection header received
0809 06:57:17.467099 (+ 1712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:17.467128 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:17.467771 (+ 643us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:17.468165 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:17.468705 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:17.470589 (+ 1884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:17.471935 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:17.472951 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:17.473139 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:17.474278 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:17.474289 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:17.474308 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:17.475019 (+ 711us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:17.475117 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:17.475158 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:17.475278 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:17.475470 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 06:57:17.475797 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":418,"threads_started":1}
I20260809 06:57:17.478479 32114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:17.479542 32114 log.cc:824] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:17.482340 32114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb: No bootstrap required, opened a new log
I20260809 06:57:17.490056 32114 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2886a76d68f41dbb759914478efedcb" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44957 } }
I20260809 06:57:17.490393 32114 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:17.490502 32114 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2886a76d68f41dbb759914478efedcb, State: Initialized, Role: FOLLOWER
I20260809 06:57:17.491106 32114 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2886a76d68f41dbb759914478efedcb" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44957 } }
I20260809 06:57:17.491343 32114 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:17.491482 32114 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:17.491647 32114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:17.493778 32114 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2886a76d68f41dbb759914478efedcb" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44957 } }
I20260809 06:57:17.494240 32114 leader_election.cc:302] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2886a76d68f41dbb759914478efedcb; no voters:
I20260809 06:57:17.494827 32114 leader_election.cc:288] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:17.494988 32119 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:17.495965 32119 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [term 1 LEADER]: Becoming Leader. State: Replica: c2886a76d68f41dbb759914478efedcb, State: Running, Role: LEADER
I20260809 06:57:17.496548 32119 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2886a76d68f41dbb759914478efedcb" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44957 } }
I20260809 06:57:17.497215 32114 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:17.499536 32120 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2886a76d68f41dbb759914478efedcb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2886a76d68f41dbb759914478efedcb" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44957 } } }
I20260809 06:57:17.499508 32121 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2886a76d68f41dbb759914478efedcb. Latest consensus state: current_term: 1 leader_uuid: "c2886a76d68f41dbb759914478efedcb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2886a76d68f41dbb759914478efedcb" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 44957 } } }
I20260809 06:57:17.500025 32120 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:17.500065 32121 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:17.501869 32127 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:17.506747 32127 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:17.515669 32127 catalog_manager.cc:1347] Generated new cluster ID: f5044e64a62548a39559ba08302df06b
I20260809 06:57:17.515872 32127 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:17.545310 32127 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:17.547024 32127 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:17.566080 32127 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb: Generated new TSK 0
I20260809 06:57:17.567220 32127 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:17.573064 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.65:0
--local_ip_for_outbound_sockets=127.10.205.65
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44957
--builtin_ntp_servers=127.10.205.84:46469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 06:57:17.917016 32138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:17.917333 32138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:17.917477 32138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:17.924487 32138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:17.924611 32138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:17.924782 32138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.65
I20260809 06:57:17.934142 32138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.205.65
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44957
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.65
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:17.935492 32138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:17.937337 32138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:17.951203 32144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:17.951181 32143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:17.951334 32146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:17.951906 32138 server_base.cc:1034] running on GCE node
I20260809 06:57:17.952574 32138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:17.953512 32138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:17.954732 32138 hybrid_clock.cc:648] HybridClock initialized: now 1786258637954689 us; error 42 us; skew 500 ppm
I20260809 06:57:17.955071 32138 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:57:17.957312 32138 webserver.cc:460] Webserver started at http://127.10.205.65:46691/ using document root <none> and password file <none>
I20260809 06:57:17.957984 32138 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:17.958073 32138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:17.958357 32138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:17.961316 32138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/data/instance:
uuid: "f8b1f3c246aa47098fecd60de3181c1d"
format_stamp: "Formatted at 2026-08-09 06:57:17 on dist-test-slave-0b58"
server_key: "f2fe63674e8dc22463ad80ac8bb7365e"
server_key_iv: "60b1c1ab184700496a4b933f9acb2411"
server_key_version: "encryptionkey@0"
I20260809 06:57:17.962076 32138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance:
uuid: "f8b1f3c246aa47098fecd60de3181c1d"
format_stamp: "Formatted at 2026-08-09 06:57:17 on dist-test-slave-0b58"
server_key: "f2fe63674e8dc22463ad80ac8bb7365e"
server_key_iv: "60b1c1ab184700496a4b933f9acb2411"
server_key_version: "encryptionkey@0"
I20260809 06:57:17.967456 32138 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:57:17.971072 32152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:17.972491 32138 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:57:17.972661 32138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/wal
uuid: "f8b1f3c246aa47098fecd60de3181c1d"
format_stamp: "Formatted at 2026-08-09 06:57:17 on dist-test-slave-0b58"
server_key: "f2fe63674e8dc22463ad80ac8bb7365e"
server_key_iv: "60b1c1ab184700496a4b933f9acb2411"
server_key_version: "encryptionkey@0"
I20260809 06:57:17.972887 32138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:18.006963 32138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:18.007867 32138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:18.008188 32138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:18.009317 32138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:18.010890 32138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:18.011008 32138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:18.011142 32138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:18.011237 32138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:18.044530 32138 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.65:43915
I20260809 06:57:18.044617 32267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.65:43915 every 8 connection(s)
I20260809 06:57:18.045885 32138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/data/info.pb
I20260809 06:57:18.046797 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 32138
I20260809 06:57:18.046979 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-0/wal/instance
I20260809 06:57:18.047611 11061 external_mini_cluster.cc:1428] Setting key d8d4494d64a7e80e4987aa86a19d1c74
I20260809 06:57:18.051043 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.66:0
--local_ip_for_outbound_sockets=127.10.205.66
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44957
--builtin_ntp_servers=127.10.205.84:46469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 06:57:18.059043 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:18.048968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.65:53263 (local address 127.10.205.126:44957)
0809 06:57:18.049780 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:18.049786 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:18.050793 (+ 1007us) server_negotiation.cc:407] Connection header received
0809 06:57:18.052721 (+ 1928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:18.052726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:18.052809 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:18.052934 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:18.053949 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:18.054670 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:18.056169 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:18.056661 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:18.056797 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:18.058172 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:18.058189 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:18.058192 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:18.058210 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:18.058259 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:18.058271 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:18.058368 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:18.058586 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 06:57:18.058687 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":566,"threads_started":1}
I20260809 06:57:18.060019 32271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:18.049715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44957 (local address 127.10.205.65:53263)
0809 06:57:18.050634 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:18.050680 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:18.052477 (+ 1797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:18.053165 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:18.053173 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:18.053256 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:18.053790 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:18.053806 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:18.054840 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:18.054844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:18.056025 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:18.056037 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:18.056893 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:18.056901 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:18.057128 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:18.057858 (+ 730us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:57:18.057861 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:18.057899 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:57:18.057977 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:18.058369 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:18.058383 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:18.058393 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 06:57:18.058572 (+ 179us) client_negotiation.cc:240] Negotiation successful
0809 06:57:18.058960 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":308,"threads_started":1}
I20260809 06:57:18.061645 32268 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44957
I20260809 06:57:18.061959 32268 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:18.062688 32268 heartbeater.cc:511] Master 127.10.205.126:44957 requested a full tablet report, sending...
I20260809 06:57:18.064771 32079 ts_manager.cc:194] Registered new tserver with Master: f8b1f3c246aa47098fecd60de3181c1d (127.10.205.65:43915)
I20260809 06:57:18.066474 32079 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.205.65:53263
W20260809 06:57:18.398557 32272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:18.398855 32272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:18.399008 32272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:18.406556 32272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:18.406688 32272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:18.406862 32272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.66
I20260809 06:57:18.416023 32272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.205.66
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44957
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.66
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:18.417423 32272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:18.419219 32272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:18.435302 32278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:18.435588 32280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:18.435302 32277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:18.436313 32272 server_base.cc:1034] running on GCE node
I20260809 06:57:18.437137 32272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:18.438464 32272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:18.439736 32272 hybrid_clock.cc:648] HybridClock initialized: now 1786258638439673 us; error 61 us; skew 500 ppm
I20260809 06:57:18.440207 32272 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:57:18.443398 32272 webserver.cc:460] Webserver started at http://127.10.205.66:44769/ using document root <none> and password file <none>
I20260809 06:57:18.444396 32272 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:18.444525 32272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:18.444921 32272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:18.449676 32272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/data/instance:
uuid: "ac08e1e3a6d1468b991ba7e1e1372257"
format_stamp: "Formatted at 2026-08-09 06:57:18 on dist-test-slave-0b58"
server_key: "3a7a5c09ed1391c71b7b376311105c97"
server_key_iv: "4e81a3498e3c0c921fd9983111877929"
server_key_version: "encryptionkey@0"
I20260809 06:57:18.450925 32272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance:
uuid: "ac08e1e3a6d1468b991ba7e1e1372257"
format_stamp: "Formatted at 2026-08-09 06:57:18 on dist-test-slave-0b58"
server_key: "3a7a5c09ed1391c71b7b376311105c97"
server_key_iv: "4e81a3498e3c0c921fd9983111877929"
server_key_version: "encryptionkey@0"
I20260809 06:57:18.458559 32272 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260809 06:57:18.464043 32287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:18.465912 32272 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260809 06:57:18.466105 32272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/wal
uuid: "ac08e1e3a6d1468b991ba7e1e1372257"
format_stamp: "Formatted at 2026-08-09 06:57:18 on dist-test-slave-0b58"
server_key: "3a7a5c09ed1391c71b7b376311105c97"
server_key_iv: "4e81a3498e3c0c921fd9983111877929"
server_key_version: "encryptionkey@0"
I20260809 06:57:18.466409 32272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:18.491056 32272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:18.492058 32272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:18.492413 32272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:18.493512 32272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:18.494916 32272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:18.495049 32272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:18.495173 32272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:18.495263 32272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:18.530501 32272 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.66:38583
I20260809 06:57:18.530556 32401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.66:38583 every 8 connection(s)
I20260809 06:57:18.531876 32272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/data/info.pb
I20260809 06:57:18.534477 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 32272
I20260809 06:57:18.534677 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/wal/instance
I20260809 06:57:18.535246 11061 external_mini_cluster.cc:1428] Setting key 10507623c739bbed31511d493b3a76bd
I20260809 06:57:18.538458 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.205.67:0
--local_ip_for_outbound_sockets=127.10.205.67
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44957
--builtin_ntp_servers=127.10.205.84:46469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 06:57:18.545158 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:18.534814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.66:45869 (local address 127.10.205.126:44957)
0809 06:57:18.535004 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:18.535016 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:18.536803 (+ 1787us) server_negotiation.cc:407] Connection header received
0809 06:57:18.538837 (+ 2034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:18.538842 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:18.538928 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:18.539034 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:18.540052 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:18.540843 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:18.542408 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:18.542812 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:18.542951 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:18.544359 (+ 1408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:18.544364 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:18.544367 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:18.544384 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:18.544417 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:18.544429 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:18.544538 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:18.544754 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 06:57:18.544853 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:57:18.546377 32404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:18.535513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44957 (local address 127.10.205.66:45869)
0809 06:57:18.536641 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:18.536689 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:18.538509 (+ 1820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:18.539265 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:18.539273 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:18.539357 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:18.539899 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:18.539914 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:18.541003 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:18.541008 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:18.542261 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:18.542273 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:18.543040 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:18.543047 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:18.543281 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:18.544008 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:57:18.544011 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:18.544048 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:57:18.544128 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:18.544540 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:18.544554 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:18.544563 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 06:57:18.544744 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 06:57:18.545138 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":344,"threads_started":1}
I20260809 06:57:18.547849 32402 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44957
I20260809 06:57:18.548180 32402 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:18.548985 32402 heartbeater.cc:511] Master 127.10.205.126:44957 requested a full tablet report, sending...
I20260809 06:57:18.550592 32079 ts_manager.cc:194] Registered new tserver with Master: ac08e1e3a6d1468b991ba7e1e1372257 (127.10.205.66:38583)
I20260809 06:57:18.551492 32079 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.205.66:45869
W20260809 06:57:18.884765 32405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:18.885051 32405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:18.885191 32405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:18.892655 32405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:18.892761 32405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:18.892923 32405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.205.67
I20260809 06:57:18.902336 32405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.205.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.205.67
--webserver_port=0
--tserver_master_addrs=127.10.205.126:44957
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.205.67
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:18.903702 32405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:18.905606 32405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:18.918718 32413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:18.918838 32410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:18.918803 32411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:18.919653 32405 server_base.cc:1034] running on GCE node
I20260809 06:57:18.920389 32405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:18.921378 32405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:18.922578 32405 hybrid_clock.cc:648] HybridClock initialized: now 1786258638922520 us; error 54 us; skew 500 ppm
I20260809 06:57:18.922911 32405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:57:18.925323 32405 webserver.cc:460] Webserver started at http://127.10.205.67:34715/ using document root <none> and password file <none>
I20260809 06:57:18.926026 32405 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:18.926172 32405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:18.926514 32405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:18.929960 32405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/data/instance:
uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad"
format_stamp: "Formatted at 2026-08-09 06:57:18 on dist-test-slave-0b58"
server_key: "a25872dbbef60b4a5c5ab9bf13a7fd74"
server_key_iv: "362ef36125361d0803d6e5ff1f6d2a31"
server_key_version: "encryptionkey@0"
I20260809 06:57:18.930832 32405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance:
uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad"
format_stamp: "Formatted at 2026-08-09 06:57:18 on dist-test-slave-0b58"
server_key: "a25872dbbef60b4a5c5ab9bf13a7fd74"
server_key_iv: "362ef36125361d0803d6e5ff1f6d2a31"
server_key_version: "encryptionkey@0"
I20260809 06:57:18.935951 32405 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 06:57:18.939356 32419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:18.940676 32405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 06:57:18.940855 32405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/wal
uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad"
format_stamp: "Formatted at 2026-08-09 06:57:18 on dist-test-slave-0b58"
server_key: "a25872dbbef60b4a5c5ab9bf13a7fd74"
server_key_iv: "362ef36125361d0803d6e5ff1f6d2a31"
server_key_version: "encryptionkey@0"
I20260809 06:57:18.941082 32405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:18.959024 32405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:18.959882 32405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:18.960245 32405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:18.961310 32405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:57:18.962790 32405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:57:18.962929 32405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:18.963073 32405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:57:18.963165 32405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:18.996361 32405 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.67:44697
I20260809 06:57:18.996402 32534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.67:44697 every 8 connection(s)
I20260809 06:57:18.997779 32405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/data/info.pb
I20260809 06:57:19.002449 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 32405
I20260809 06:57:19.002658 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/wal/instance
I20260809 06:57:19.003265 11061 external_mini_cluster.cc:1428] Setting key 887258f194dc216076709395398dd75e
I20260809 06:57:19.010696 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.000404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:52929 (local address 127.10.205.126:44957)
0809 06:57:19.000589 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:19.000594 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:19.002093 (+ 1499us) server_negotiation.cc:407] Connection header received
0809 06:57:19.004446 (+ 2353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:19.004452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:19.004538 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:19.004660 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:19.005865 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.006705 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.008234 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.008687 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.008795 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.010056 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:19.010060 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:19.010063 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:19.010078 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:19.010105 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:19.010116 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:19.010179 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:19.010371 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 06:57:19.010441 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:57:19.011658 32537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.000953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:44957 (local address 127.10.205.67:52929)
0809 06:57:19.001901 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.001943 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:19.004098 (+ 2155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:19.004903 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:19.004911 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:19.005024 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:19.005659 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:19.005676 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.006855 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.006859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:19.008107 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:19.008119 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.008881 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.008885 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:19.009079 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.009788 (+ 709us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:57:19.009790 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:19.009837 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:57:19.009907 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:19.010196 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:19.010203 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:19.010209 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:57:19.010346 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 06:57:19.010614 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":289,"threads_started":1}
I20260809 06:57:19.012972 32535 heartbeater.cc:347] Connected to a master server at 127.10.205.126:44957
I20260809 06:57:19.013217 32535 heartbeater.cc:464] Registering TS with master...
I20260809 06:57:19.013895 32535 heartbeater.cc:511] Master 127.10.205.126:44957 requested a full tablet report, sending...
I20260809 06:57:19.015228 32079 ts_manager.cc:194] Registered new tserver with Master: 44c5d14f6ace4fffaf4b2df44e5ce8ad (127.10.205.67:44697)
I20260809 06:57:19.016053 32079 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.205.67:52929
I20260809 06:57:19.018381 11061 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:57:19.027899 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.022458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56066 (local address 127.10.205.126:44957)
0809 06:57:19.022672 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:19.022681 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:19.023063 (+ 382us) server_negotiation.cc:407] Connection header received
0809 06:57:19.023185 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:19.023188 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:19.023257 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:19.023332 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:19.023757 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.024466 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.025674 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.026084 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.026201 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.027173 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:19.027177 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:19.027180 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:19.027197 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:19.027228 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:19.027240 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:19.027307 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:19.027487 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 06:57:19.027554 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:57:19.031638 32079 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56066:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:57:19.038410 32079 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:57:19.069435 32268 heartbeater.cc:503] Master 127.10.205.126:44957 was elected leader, sending a full tablet report...
I20260809 06:57:19.073108 32548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.050721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43172 (local address 127.10.205.67:44697)
0809 06:57:19.063694 (+ 12973us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:19.063706 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:19.063760 (+ 54us) server_negotiation.cc:407] Connection header received
0809 06:57:19.063905 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:19.063917 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:19.064225 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:19.065459 (+ 1234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:19.065814 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.067974 (+ 2160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.070483 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.071751 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.071935 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.072215 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:19.072506 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 06:57:19.072675 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12776,"thread_start_us":12619,"threads_started":1}
I20260809 06:57:19.073129 32549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.050497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.67:44697 (local address 127.0.0.1:43172)
0809 06:57:19.062534 (+ 12037us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.062587 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:19.062816 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:19.064547 (+ 1731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:19.064558 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:19.064603 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:19.065178 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:19.065195 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.068187 (+ 2992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.068196 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:19.070231 (+ 2035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:19.070249 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.071976 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.071982 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:19.072193 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.072286 (+ 93us) client_negotiation.cc:769] Sending connection context
0809 06:57:19.072458 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 06:57:19.072686 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11780,"mutex_wait_us":1,"thread_start_us":16510,"threads_started":1}
I20260809 06:57:19.077057 32550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.051040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36944 (local address 127.10.205.66:38583)
0809 06:57:19.061903 (+ 10863us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:19.061917 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:19.067439 (+ 5522us) server_negotiation.cc:407] Connection header received
0809 06:57:19.068620 (+ 1181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:19.068629 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:19.068864 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:19.069006 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:19.070259 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.071760 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.074384 (+ 2624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.075699 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.075802 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.076008 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:19.076579 (+ 571us) server_negotiation.cc:299] Negotiation successful
0809 06:57:19.076737 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10583,"thread_start_us":11917,"threads_started":1}
I20260809 06:57:19.077879 32547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.050783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:38583 (local address 127.0.0.1:36944)
0809 06:57:19.067305 (+ 16522us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.067334 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:19.068378 (+ 1044us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:19.069294 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:19.069298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:19.069325 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:19.069714 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:19.069726 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.071992 (+ 2266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.071999 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:19.074111 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:19.074149 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.076200 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.076205 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:19.076390 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.076420 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 06:57:19.077283 (+ 863us) client_negotiation.cc:240] Negotiation successful
0809 06:57:19.077424 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16376,"mutex_wait_us":27,"thread_start_us":11323,"threads_started":1}
I20260809 06:57:19.077900 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.063815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43915 (local address 127.0.0.1:33740)
0809 06:57:19.067927 (+ 4112us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.067950 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:19.068055 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:19.069891 (+ 1836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:19.069896 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:19.069925 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:19.071701 (+ 1776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:19.071716 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.073687 (+ 1971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.073694 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:19.075276 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:19.075288 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.077035 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.077039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:19.077309 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.077340 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 06:57:19.077436 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 06:57:19.077529 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3983,"thread_start_us":4296,"threads_started":1}
I20260809 06:57:19.077739 32469 tablet_service.cc:1467] Processing CreateTablet for tablet 69d0e012362641d1bd22538315025e58 (DEFAULT_TABLE table=test-table [id=52a1f72d293842ab82193f6eae50f1f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:19.078567 32551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.063448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33740 (local address 127.10.205.65:43915)
0809 06:57:19.068747 (+ 5299us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:19.068764 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:19.068788 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:57:19.068870 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:19.068877 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:19.069085 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:19.069834 (+ 749us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:19.071936 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.073516 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.075456 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.076554 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.076675 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.076940 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:19.077801 (+ 861us) server_negotiation.cc:299] Negotiation successful
0809 06:57:19.077951 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5126,"thread_start_us":4978,"threads_started":1}
I20260809 06:57:19.079438 32469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69d0e012362641d1bd22538315025e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:19.081646 32202 tablet_service.cc:1467] Processing CreateTablet for tablet 69d0e012362641d1bd22538315025e58 (DEFAULT_TABLE table=test-table [id=52a1f72d293842ab82193f6eae50f1f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:19.081646 32336 tablet_service.cc:1467] Processing CreateTablet for tablet 69d0e012362641d1bd22538315025e58 (DEFAULT_TABLE table=test-table [id=52a1f72d293842ab82193f6eae50f1f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:57:19.082984 32336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69d0e012362641d1bd22538315025e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:19.082985 32202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69d0e012362641d1bd22538315025e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:19.090989 32553 tablet_bootstrap.cc:492] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad: Bootstrap starting.
I20260809 06:57:19.094596 32553 tablet_bootstrap.cc:654] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:19.095613 32553 log.cc:824] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:19.097723 32555 tablet_bootstrap.cc:492] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257: Bootstrap starting.
I20260809 06:57:19.098951 32553 tablet_bootstrap.cc:492] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad: No bootstrap required, opened a new log
I20260809 06:57:19.099260 32553 ts_tablet_manager.cc:1397] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 06:57:19.101004 32556 tablet_bootstrap.cc:492] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d: Bootstrap starting.
I20260809 06:57:19.101604 32555 tablet_bootstrap.cc:654] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:19.102837 32555 log.cc:824] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:19.104385 32556 tablet_bootstrap.cc:654] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:19.105284 32556 log.cc:824] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:19.105938 32555 tablet_bootstrap.cc:492] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257: No bootstrap required, opened a new log
I20260809 06:57:19.106235 32555 ts_tablet_manager.cc:1397] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 06:57:19.108393 32556 tablet_bootstrap.cc:492] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d: No bootstrap required, opened a new log
I20260809 06:57:19.109935 32556 ts_tablet_manager.cc:1397] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 06:57:19.117941 32553 raft_consensus.cc:348] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 44697 } } peers { permanent_uuid: "ac08e1e3a6d1468b991ba7e1e1372257" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38583 } } peers { permanent_uuid: "f8b1f3c246aa47098fecd60de3181c1d" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43915 } }
I20260809 06:57:19.118428 32553 raft_consensus.cc:374] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:19.118568 32553 raft_consensus.cc:729] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c5d14f6ace4fffaf4b2df44e5ce8ad, State: Initialized, Role: FOLLOWER
I20260809 06:57:19.119220 32553 consensus_queue.cc:260] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 44697 } } peers { permanent_uuid: "ac08e1e3a6d1468b991ba7e1e1372257" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38583 } } peers { permanent_uuid: "f8b1f3c246aa47098fecd60de3181c1d" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43915 } }
I20260809 06:57:19.123337 32556 raft_consensus.cc:348] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 44697 } } peers { permanent_uuid: "ac08e1e3a6d1468b991ba7e1e1372257" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38583 } } peers { permanent_uuid: "f8b1f3c246aa47098fecd60de3181c1d" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43915 } }
I20260809 06:57:19.123952 32556 raft_consensus.cc:374] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:19.124105 32556 raft_consensus.cc:729] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8b1f3c246aa47098fecd60de3181c1d, State: Initialized, Role: FOLLOWER
I20260809 06:57:19.124029 32555 raft_consensus.cc:348] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 44697 } } peers { permanent_uuid: "ac08e1e3a6d1468b991ba7e1e1372257" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38583 } } peers { permanent_uuid: "f8b1f3c246aa47098fecd60de3181c1d" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43915 } }
I20260809 06:57:19.124696 32555 raft_consensus.cc:374] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:19.124857 32555 raft_consensus.cc:729] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac08e1e3a6d1468b991ba7e1e1372257, State: Initialized, Role: FOLLOWER
I20260809 06:57:19.125762 32556 consensus_queue.cc:260] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 44697 } } peers { permanent_uuid: "ac08e1e3a6d1468b991ba7e1e1372257" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38583 } } peers { permanent_uuid: "f8b1f3c246aa47098fecd60de3181c1d" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43915 } }
I20260809 06:57:19.125818 32555 consensus_queue.cc:260] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 44697 } } peers { permanent_uuid: "ac08e1e3a6d1468b991ba7e1e1372257" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38583 } } peers { permanent_uuid: "f8b1f3c246aa47098fecd60de3181c1d" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43915 } }
I20260809 06:57:19.127892 32535 heartbeater.cc:503] Master 127.10.205.126:44957 was elected leader, sending a full tablet report...
I20260809 06:57:19.130497 32553 ts_tablet_manager.cc:1428] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad: Time spent starting tablet: real 0.031s user 0.015s sys 0.006s
I20260809 06:57:19.131469 32402 heartbeater.cc:503] Master 127.10.205.126:44957 was elected leader, sending a full tablet report...
I20260809 06:57:19.134596 32556 ts_tablet_manager.cc:1428] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d: Time spent starting tablet: real 0.024s user 0.013s sys 0.008s
I20260809 06:57:19.136145 32555 ts_tablet_manager.cc:1428] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257: Time spent starting tablet: real 0.030s user 0.014s sys 0.004s
I20260809 06:57:19.233801 32559 raft_consensus.cc:482] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:57:19.234212 32559 raft_consensus.cc:504] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 44697 } } peers { permanent_uuid: "ac08e1e3a6d1468b991ba7e1e1372257" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38583 } } peers { permanent_uuid: "f8b1f3c246aa47098fecd60de3181c1d" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43915 } }
I20260809 06:57:19.236604 32559 leader_election.cc:288] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac08e1e3a6d1468b991ba7e1e1372257 (127.10.205.66:38583), f8b1f3c246aa47098fecd60de3181c1d (127.10.205.65:43915)
I20260809 06:57:19.243887 32537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.237021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.66:38583 (local address 127.10.205.67:54839)
0809 06:57:19.237252 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.237276 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:19.237440 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:19.238086 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:19.238093 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:19.238127 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:19.238403 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:19.238417 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.239737 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.239742 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:19.241218 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:19.241230 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.243104 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.243110 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:19.243322 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.243363 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 06:57:19.243458 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 06:57:19.243597 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 06:57:19.244166 32550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.237053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:54839 (local address 127.10.205.66:38583)
0809 06:57:19.237249 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:19.237265 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:19.237381 (+ 116us) server_negotiation.cc:407] Connection header received
0809 06:57:19.237669 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:19.237677 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:19.237780 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:19.237866 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:19.238601 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.239613 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.241398 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.242934 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.243114 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.243208 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:19.243515 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 06:57:19.243691 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:57:19.245054 32562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.237456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43915 (local address 127.10.205.67:35845)
0809 06:57:19.238625 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.238641 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:19.238772 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:19.239194 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:19.239199 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:19.239223 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:57:19.239548 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:19.239559 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.241218 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.241223 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:19.242516 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:19.242527 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.244197 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.244204 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:19.244392 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.244416 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:57:19.244575 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 06:57:19.244747 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1036,"thread_start_us":859,"threads_started":1}
I20260809 06:57:19.245329 32551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.237869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.205.67:35845 (local address 127.10.205.65:43915)
0809 06:57:19.238092 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:19.238101 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:19.238747 (+ 646us) server_negotiation.cc:407] Connection header received
0809 06:57:19.238908 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:19.238916 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:19.239027 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:19.239153 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:57:19.239736 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.241042 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.242718 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.243833 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.244011 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.244086 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:19.244638 (+ 552us) server_negotiation.cc:299] Negotiation successful
0809 06:57:19.244828 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 06:57:19.245410 32356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69d0e012362641d1bd22538315025e58" candidate_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac08e1e3a6d1468b991ba7e1e1372257" is_pre_election: true
I20260809 06:57:19.246025 32356 raft_consensus.cc:2454] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c5d14f6ace4fffaf4b2df44e5ce8ad in term 0.
I20260809 06:57:19.246776 32421 leader_election.cc:302] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c5d14f6ace4fffaf4b2df44e5ce8ad, ac08e1e3a6d1468b991ba7e1e1372257; no voters:
I20260809 06:57:19.246569 32223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69d0e012362641d1bd22538315025e58" candidate_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8b1f3c246aa47098fecd60de3181c1d" is_pre_election: true
I20260809 06:57:19.247165 32559 raft_consensus.cc:2781] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:57:19.247234 32223 raft_consensus.cc:2454] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c5d14f6ace4fffaf4b2df44e5ce8ad in term 0.
I20260809 06:57:19.247329 32559 raft_consensus.cc:482] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:57:19.247467 32559 raft_consensus.cc:3037] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 0 FOLLOWER]: Advancing to term 1
W20260809 06:57:19.249569 32536 tablet.cc:2369] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:57:19.249856 32559 raft_consensus.cc:504] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 44697 } } peers { permanent_uuid: "ac08e1e3a6d1468b991ba7e1e1372257" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38583 } } peers { permanent_uuid: "f8b1f3c246aa47098fecd60de3181c1d" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43915 } }
I20260809 06:57:19.250489 32559 leader_election.cc:288] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [CANDIDATE]: Term 1 election: Requested vote from peers ac08e1e3a6d1468b991ba7e1e1372257 (127.10.205.66:38583), f8b1f3c246aa47098fecd60de3181c1d (127.10.205.65:43915)
I20260809 06:57:19.250912 32356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69d0e012362641d1bd22538315025e58" candidate_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac08e1e3a6d1468b991ba7e1e1372257"
I20260809 06:57:19.251024 32223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69d0e012362641d1bd22538315025e58" candidate_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8b1f3c246aa47098fecd60de3181c1d"
I20260809 06:57:19.251117 32356 raft_consensus.cc:3037] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:19.251259 32223 raft_consensus.cc:3037] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:19.253420 32356 raft_consensus.cc:2454] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c5d14f6ace4fffaf4b2df44e5ce8ad in term 1.
I20260809 06:57:19.253774 32421 leader_election.cc:302] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c5d14f6ace4fffaf4b2df44e5ce8ad, ac08e1e3a6d1468b991ba7e1e1372257; no voters:
I20260809 06:57:19.254042 32559 raft_consensus.cc:2781] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:19.254570 32559 raft_consensus.cc:686] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 1 LEADER]: Becoming Leader. State: Replica: 44c5d14f6ace4fffaf4b2df44e5ce8ad, State: Running, Role: LEADER
I20260809 06:57:19.255218 32223 raft_consensus.cc:2454] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c5d14f6ace4fffaf4b2df44e5ce8ad in term 1.
I20260809 06:57:19.255134 32559 consensus_queue.cc:237] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 44697 } } peers { permanent_uuid: "ac08e1e3a6d1468b991ba7e1e1372257" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38583 } } peers { permanent_uuid: "f8b1f3c246aa47098fecd60de3181c1d" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43915 } }
I20260809 06:57:19.260673 32077 catalog_manager.cc:5495] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c5d14f6ace4fffaf4b2df44e5ce8ad (127.10.205.67). New cstate: current_term: 1 leader_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c5d14f6ace4fffaf4b2df44e5ce8ad" member_type: VOTER last_known_addr { host: "127.10.205.67" port: 44697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac08e1e3a6d1468b991ba7e1e1372257" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8b1f3c246aa47098fecd60de3181c1d" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43915 } health_report { overall_health: UNKNOWN } } }
I20260809 06:57:19.280186 32548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.272839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43174 (local address 127.10.205.67:44697)
0809 06:57:19.273501 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:19.273509 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:19.273532 (+ 23us) server_negotiation.cc:407] Connection header received
0809 06:57:19.273641 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:19.273649 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:19.273777 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:19.273931 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:57:19.274269 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.275579 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.277258 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.278074 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.278223 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.278676 (+ 453us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:57:19.279383 (+ 707us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:57:19.279538 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:19.279591 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 06:57:19.279851 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389}
W20260809 06:57:19.284224 32403 tablet.cc:2369] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:57:19.289664 32223 raft_consensus.cc:1261] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d [term 1 FOLLOWER]: Refusing update from remote peer 44c5d14f6ace4fffaf4b2df44e5ce8ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:57:19.289772 32356 raft_consensus.cc:1261] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257 [term 1 FOLLOWER]: Refusing update from remote peer 44c5d14f6ace4fffaf4b2df44e5ce8ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:57:19.290594 32563 consensus_queue.cc:1035] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8b1f3c246aa47098fecd60de3181c1d" member_type: VOTER last_known_addr { host: "127.10.205.65" port: 43915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:57:19.291112 32559 consensus_queue.cc:1035] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac08e1e3a6d1468b991ba7e1e1372257" member_type: VOTER last_known_addr { host: "127.10.205.66" port: 38583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 06:57:19.298621 32269 tablet.cc:2369] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:57:19.309139 32566 mvcc.cc:205] Tried to move back new op lower bound from 7316515386520211456 to 7316515386393837568. Current Snapshot: MvccSnapshot[applied={T|T < 7316515386520211456}]
I20260809 06:57:19.339826 32078 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:57:19.340154 32078 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:57:19.344982 32078 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c2886a76d68f41dbb759914478efedcb: Sending DeleteTablet for 3 replicas of tablet 69d0e012362641d1bd22538315025e58
I20260809 06:57:19.346290 32336 tablet_service.cc:1514] Processing DeleteTablet for tablet 69d0e012362641d1bd22538315025e58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:19 UTC) from {username='slave'} at 127.0.0.1:36944
I20260809 06:57:19.346341 32469 tablet_service.cc:1514] Processing DeleteTablet for tablet 69d0e012362641d1bd22538315025e58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:19 UTC) from {username='slave'} at 127.0.0.1:43172
I20260809 06:57:19.349689 32202 tablet_service.cc:1514] Processing DeleteTablet for tablet 69d0e012362641d1bd22538315025e58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:57:19 UTC) from {username='slave'} at 127.0.0.1:33740
I20260809 06:57:19.358428 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 32138
I20260809 06:57:19.393785 32578 tablet_replica.cc:330] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d: stopping tablet replica
I20260809 06:57:19.394572 32578 raft_consensus.cc:2229] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:57:19.395314 32578 raft_consensus.cc:2258] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:19.396605 32576 tablet_replica.cc:330] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257: stopping tablet replica
I20260809 06:57:19.397894 32577 tablet_replica.cc:330] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad: stopping tablet replica
I20260809 06:57:19.398375 32577 raft_consensus.cc:2229] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:57:19.398973 32577 raft_consensus.cc:2258] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:19.401618 32577 ts_tablet_manager.cc:1905] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:19.401854 32551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.359875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33756 (local address 127.10.205.65:43915)
0809 06:57:19.360060 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:19.360066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:19.386332 (+ 26266us) server_negotiation.cc:407] Connection header received
0809 06:57:19.386684 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:19.386691 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:19.386840 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:19.386927 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:19.387620 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.388863 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.390783 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.391433 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.391534 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.399859 (+ 8325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:19.399871 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:19.399891 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:19.400763 (+ 872us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:19.400833 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:19.400859 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:19.400954 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:19.401325 (+ 371us) server_negotiation.cc:299] Negotiation successful
0809 06:57:19.401455 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:57:19.403110 32576 raft_consensus.cc:2229] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:57:19.403460 32263 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:19.403682 32576 raft_consensus.cc:2258] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:57:19.406579 32576 ts_tablet_manager.cc:1905] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:19.413074 32577 ts_tablet_manager.cc:1918] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:19.413329 32577 log.cc:1196] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-2/wal/wals/69d0e012362641d1bd22538315025e58
I20260809 06:57:19.414001 32577 ts_tablet_manager.cc:1939] T 69d0e012362641d1bd22538315025e58 P 44c5d14f6ace4fffaf4b2df44e5ce8ad: Deleting consensus metadata
I20260809 06:57:19.415977 32065 catalog_manager.cc:4841] TS 44c5d14f6ace4fffaf4b2df44e5ce8ad (127.10.205.67:44697): tablet 69d0e012362641d1bd22538315025e58 (table test-table [id=52a1f72d293842ab82193f6eae50f1f1]) successfully deleted
I20260809 06:57:19.416170 32576 ts_tablet_manager.cc:1918] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:57:19.420882 32576 log.cc:1196] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257: Deleting WAL directory at /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786258311159624-11061-0/minicluster-data/ts-1/wal/wals/69d0e012362641d1bd22538315025e58
I20260809 06:57:19.421569 32576 ts_tablet_manager.cc:1939] T 69d0e012362641d1bd22538315025e58 P ac08e1e3a6d1468b991ba7e1e1372257: Deleting consensus metadata
I20260809 06:57:19.423734 32063 catalog_manager.cc:4841] TS ac08e1e3a6d1468b991ba7e1e1372257 (127.10.205.66:38583): tablet 69d0e012362641d1bd22538315025e58 (table test-table [id=52a1f72d293842ab82193f6eae50f1f1]) successfully deleted
I20260809 06:57:19.404358 32578 ts_tablet_manager.cc:1905] T 69d0e012362641d1bd22538315025e58 P f8b1f3c246aa47098fecd60de3181c1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:57:19.525391 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 32138
W20260809 06:57:19.554728 32063 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.205.65:43915 (error 108)
I20260809 06:57:19.555120 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 32272
I20260809 06:57:19.557384 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.556803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43915 (local address 127.0.0.1:33770)
0809 06:57:19.557064 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.557202 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
W20260809 06:57:19.557657 32063 catalog_manager.cc:4584] TS f8b1f3c246aa47098fecd60de3181c1d (127.10.205.65:43915): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 69d0e012362641d1bd22538315025e58: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43915: connect: Connection refused (error 111)
I20260809 06:57:19.562829 32550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.555987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36956 (local address 127.10.205.66:38583)
0809 06:57:19.556181 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:19.556188 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:19.556586 (+ 398us) server_negotiation.cc:407] Connection header received
0809 06:57:19.556671 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:19.556675 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:19.556782 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:19.556905 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:19.557352 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.558244 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.559621 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.560046 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.560198 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.561461 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:19.561471 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:19.561484 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:19.562063 (+ 579us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:19.562112 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:19.562137 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:19.562293 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:19.562395 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 06:57:19.562506 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:57:19.563570 32396 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:19.611541 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.610972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43915 (local address 127.0.0.1:33776)
0809 06:57:19.611234 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.611349 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260809 06:57:19.612857 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.612394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43915 (local address 127.0.0.1:33790)
0809 06:57:19.612574 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.612682 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 06:57:19.655521 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 32272
I20260809 06:57:19.673905 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.673251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43915 (local address 127.0.0.1:33798)
0809 06:57:19.673551 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.673677 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260809 06:57:19.675328 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.674862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43915 (local address 127.0.0.1:33800)
0809 06:57:19.675062 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.675153 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 06:57:19.676920 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 32405
I20260809 06:57:19.685263 32548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.677842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43178 (local address 127.10.205.67:44697)
0809 06:57:19.678065 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:19.678071 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:19.678093 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:57:19.678163 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:19.678168 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:19.678285 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:19.678401 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:19.678811 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.680041 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.681428 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:19.682132 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:19.682275 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:19.683374 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:19.683386 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:19.683407 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:19.684327 (+ 920us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:19.684425 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:19.684454 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:19.684583 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:19.684747 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 06:57:19.684847 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 06:57:19.686100 32530 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:19.756559 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.755881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43915 (local address 127.0.0.1:33812)
0809 06:57:19.756186 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.756386 (+ 200us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167}
I20260809 06:57:19.757622 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.757248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43915 (local address 127.0.0.1:33824)
0809 06:57:19.757433 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.757500 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260809 06:57:19.811738 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 32405
I20260809 06:57:19.834816 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 32046
I20260809 06:57:19.836043 32109 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:19.947504 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:19.947051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.65:43915 (local address 127.0.0.1:33832)
0809 06:57:19.947211 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:19.947319 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.65:43915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 06:57:19.947552 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 32046
2026-08-09T06:57:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3032 ms)
[----------] 6 tests from EncryptionPolicyTest (22758 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:20 dist-test-slave-0b58 krb5kdc[32587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:20 dist-test-slave-0b58 krb5kdc[32587](info): set up 2 sockets
Aug 09 06:57:20 dist-test-slave-0b58 krb5kdc[32587](info): commencing operation
krb5kdc: starting...
W20260809 06:57:21.087528 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.006s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:21 dist-test-slave-0b58 krb5kdc[32587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:57:21.415159 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44313
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44313
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:21.759554 32600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:21.759943 32600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:21.760118 32600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:21.767781 32600 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:21.767957 32600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:21.768070 32600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:21.768183 32600 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:21.768299 32600 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:21.778815 32600 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44313
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:21.780296 32600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:21.781709 32600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:21.793799 32606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:21.793911 32608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:21.794152 32605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:21.795022 32600 server_base.cc:1034] running on GCE node
I20260809 06:57:21.795964 32600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:21.797456 32600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:21.798663 32600 hybrid_clock.cc:648] HybridClock initialized: now 1786258641798623 us; error 26 us; skew 500 ppm
I20260809 06:57:21.799073 32600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:21 dist-test-slave-0b58 krb5kdc[32587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258641, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:21.802346 32600 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:57:21.803807 32600 webserver.cc:460] Webserver started at http://127.0.0.1:40467/ using document root <none> and password file <none>
I20260809 06:57:21.804610 32600 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:21.804749 32600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:21.805078 32600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:21.808233 32600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "7933a1d3a2184e82888e62ad38c04155"
format_stamp: "Formatted at 2026-08-09 06:57:21 on dist-test-slave-0b58"
server_key: "65f305efaabc38b0eac82f4d72069b62"
server_key_iv: "2a96065b44118ee657c247e72dcbb433"
server_key_version: "encryptionkey@0"
I20260809 06:57:21.809126 32600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "7933a1d3a2184e82888e62ad38c04155"
format_stamp: "Formatted at 2026-08-09 06:57:21 on dist-test-slave-0b58"
server_key: "65f305efaabc38b0eac82f4d72069b62"
server_key_iv: "2a96065b44118ee657c247e72dcbb433"
server_key_version: "encryptionkey@0"
I20260809 06:57:21.814338 32600 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 06:57:21.817912 32615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:21.819180 32600 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:57:21.819368 32600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "7933a1d3a2184e82888e62ad38c04155"
format_stamp: "Formatted at 2026-08-09 06:57:21 on dist-test-slave-0b58"
server_key: "65f305efaabc38b0eac82f4d72069b62"
server_key_iv: "2a96065b44118ee657c247e72dcbb433"
server_key_version: "encryptionkey@0"
I20260809 06:57:21.819581 32600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:21.833884 32600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:21.837968 32600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:21.838310 32600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:21.858554 32600 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44313
I20260809 06:57:21.858582 32669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44313 every 8 connection(s)
I20260809 06:57:21.860080 32600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:21.863974 32670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:21.866564 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 32600
I20260809 06:57:21.866786 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:21.867645 11061 external_mini_cluster.cc:1428] Setting key 4fd92fc58096129ac0e20567582cb148
I20260809 06:57:21.877610 32670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155: Bootstrap starting.
I20260809 06:57:21.881764 32670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:21.883169 32670 log.cc:824] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:57:21 dist-test-slave-0b58 krb5kdc[32587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 06:57:21.886396 32670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155: No bootstrap required, opened a new log
I20260809 06:57:21.893132 32673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:21.869826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45931 (local address 127.0.0.1:44313)
0809 06:57:21.870715 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:21.870727 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:21.870780 (+ 53us) server_negotiation.cc:407] Connection header received
0809 06:57:21.872553 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:21.872577 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:21.872976 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:21.873302 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:21.875214 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:21.876705 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:21.878570 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:21.879247 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:21.879504 (+ 257us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:21.885079 (+ 5575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:21.885086 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:21.885101 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:21.885142 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:21.888618 (+ 3476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:21.889486 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:21.889493 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:21.889500 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:21.889676 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:21.890197 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:21.890201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:21.890203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:21.890788 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:21.891145 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:21.891651 (+ 506us) server_negotiation.cc:299] Negotiation successful
0809 06:57:21.891990 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":416,"threads_started":1}
I20260809 06:57:21.894858 32670 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7933a1d3a2184e82888e62ad38c04155" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44313 } }
I20260809 06:57:21.895232 32670 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:21.895401 32670 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7933a1d3a2184e82888e62ad38c04155, State: Initialized, Role: FOLLOWER
I20260809 06:57:21.896085 32670 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7933a1d3a2184e82888e62ad38c04155" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44313 } }
I20260809 06:57:21.896368 32670 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:21.896557 32670 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:21.896775 32670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:21.897544 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:21.899230 32670 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7933a1d3a2184e82888e62ad38c04155" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44313 } }
I20260809 06:57:21.899788 32670 leader_election.cc:302] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7933a1d3a2184e82888e62ad38c04155; no voters:
I20260809 06:57:21.900508 32670 leader_election.cc:288] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:21.900667 32676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:21.901892 32676 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [term 1 LEADER]: Becoming Leader. State: Replica: 7933a1d3a2184e82888e62ad38c04155, State: Running, Role: LEADER
I20260809 06:57:21.902482 32676 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7933a1d3a2184e82888e62ad38c04155" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44313 } }
I20260809 06:57:21.903345 32670 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:21.905984 32679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7933a1d3a2184e82888e62ad38c04155" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7933a1d3a2184e82888e62ad38c04155" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44313 } } }
I20260809 06:57:21.906548 32679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:21.906421 32681 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7933a1d3a2184e82888e62ad38c04155. Latest consensus state: current_term: 1 leader_uuid: "7933a1d3a2184e82888e62ad38c04155" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7933a1d3a2184e82888e62ad38c04155" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44313 } } }
I20260809 06:57:21.906755 32681 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:21.908425 32685 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:21.913764 32685 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:21.930996 32673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:21.902909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54773 (local address 127.0.0.1:44313)
0809 06:57:21.903086 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:21.903094 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:21.903531 (+ 437us) server_negotiation.cc:407] Connection header received
0809 06:57:21.903734 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:21.903740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:21.903818 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:21.903934 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:21.906094 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:21.907644 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:21.909863 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:21.910872 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:21.911044 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:21.916000 (+ 4956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:21.916014 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:21.916023 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:21.916219 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:21.921915 (+ 5696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:21.923468 (+ 1553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:21.923474 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:21.923480 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:21.923672 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:21.924483 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:21.924491 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:21.924497 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:21.927050 (+ 2553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:21.929191 (+ 2141us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:21.929539 (+ 348us) server_negotiation.cc:299] Negotiation successful
0809 06:57:21.929774 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 06:57:21.943614 32685 catalog_manager.cc:1347] Generated new cluster ID: 36a25646ccf94acda8c54725b09a6d4a
I20260809 06:57:21.943773 32685 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:21.973278 32685 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:21.975373 32685 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:21.982642 32685 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7933a1d3a2184e82888e62ad38c04155: Generated new TSK 0
I20260809 06:57:21.983705 32685 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:21.999424 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 32600
I20260809 06:57:22.000809 32665 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:22.092077 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 32600
W20260809 06:57:22.113149 32585 connection.cc:535] client connection to 127.0.0.1:44313 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44313): Connection reset by peer (error 104)
2026-08-09T06:57:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2137 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:22 dist-test-slave-0b58 krb5kdc[32702](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:22 dist-test-slave-0b58 krb5kdc[32702](info): set up 2 sockets
Aug 09 06:57:22 dist-test-slave-0b58 krb5kdc[32702](info): commencing operation
krb5kdc: starting...
W20260809 06:57:23.235178 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:23 dist-test-slave-0b58 krb5kdc[32702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258643, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:57:23.549646 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33467
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:23.894383 32716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:23.894651 32716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:23.894737 32716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:23.901669 32716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:23.901782 32716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:23.901889 32716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:23.901997 32716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:23.902088 32716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:23.912708 32716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33467
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:23.914057 32716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:23.915429 32716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:23.927589 32724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:23.927541 32722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:23.927683 32721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:23.928371 32716 server_base.cc:1034] running on GCE node
I20260809 06:57:23.929096 32716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:23.930524 32716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:23.931759 32716 hybrid_clock.cc:648] HybridClock initialized: now 1786258643931723 us; error 50 us; skew 500 ppm
I20260809 06:57:23.932109 32716 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:23 dist-test-slave-0b58 krb5kdc[32702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258643, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:23.935240 32716 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:57:23.936853 32716 webserver.cc:460] Webserver started at http://127.0.0.1:42719/ using document root <none> and password file <none>
I20260809 06:57:23.937531 32716 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:23.937704 32716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:23.938019 32716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:23.941190 32716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "62daa14c9be9490f8784a3765e269e12"
format_stamp: "Formatted at 2026-08-09 06:57:23 on dist-test-slave-0b58"
server_key: "ff2d7523933a8f412bab9ea8bfdef7d8"
server_key_iv: "f8ecaed85428433adc2cb9c269dd8943"
server_key_version: "encryptionkey@0"
I20260809 06:57:23.941985 32716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "62daa14c9be9490f8784a3765e269e12"
format_stamp: "Formatted at 2026-08-09 06:57:23 on dist-test-slave-0b58"
server_key: "ff2d7523933a8f412bab9ea8bfdef7d8"
server_key_iv: "f8ecaed85428433adc2cb9c269dd8943"
server_key_version: "encryptionkey@0"
I20260809 06:57:23.947360 32716 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:57:23.950886 32732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:23.952232 32716 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:57:23.952546 32716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "62daa14c9be9490f8784a3765e269e12"
format_stamp: "Formatted at 2026-08-09 06:57:23 on dist-test-slave-0b58"
server_key: "ff2d7523933a8f412bab9ea8bfdef7d8"
server_key_iv: "f8ecaed85428433adc2cb9c269dd8943"
server_key_version: "encryptionkey@0"
I20260809 06:57:23.952747 32716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:23.974762 32716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:23.978755 32716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:23.979084 32716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:23.997426 32716 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33467
I20260809 06:57:23.997459 316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33467 every 8 connection(s)
I20260809 06:57:23.998858 32716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:24.002538 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 32716
I20260809 06:57:24.002729 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:24.002750 317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:24.003319 11061 external_mini_cluster.cc:1428] Setting key d5075f09b910a56b0181b48295f4ddf2
I20260809 06:57:24.016613 320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:24.005081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42901 (local address 127.0.0.1:33467)
0809 06:57:24.005940 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:24.005951 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:24.005993 (+ 42us) server_negotiation.cc:407] Connection header received
0809 06:57:24.007611 (+ 1618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:24.007639 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:24.008008 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:24.008385 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:24.008921 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:24.010241 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:24.012071 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:24.012815 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:24.012941 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:24.014296 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:24.014303 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:24.014314 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:24.014859 (+ 545us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:24.014929 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:24.014958 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:24.015080 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:24.015368 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 06:57:24.015556 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":376,"threads_started":1}
I20260809 06:57:24.016917 317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12: Bootstrap starting.
I20260809 06:57:24.020051 317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:24.020358 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:24.021342 317 log.cc:824] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:24.024668 317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12: No bootstrap required, opened a new log
I20260809 06:57:24.032747 320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:24.025569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37917 (local address 127.0.0.1:33467)
0809 06:57:24.025749 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:24.025754 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:24.026322 (+ 568us) server_negotiation.cc:407] Connection header received
0809 06:57:24.026526 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:24.026530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:24.026589 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:24.026680 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:24.027307 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:24.028072 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:24.030041 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:24.030511 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:24.030607 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:24.031859 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:24.031864 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:24.031867 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:24.031888 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:24.031926 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:24.031941 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:24.032029 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:24.032251 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 06:57:24.032376 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:57:24.034880 317 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62daa14c9be9490f8784a3765e269e12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33467 } }
I20260809 06:57:24.035274 317 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:24.035395 317 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62daa14c9be9490f8784a3765e269e12, State: Initialized, Role: FOLLOWER
I20260809 06:57:24.036062 317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62daa14c9be9490f8784a3765e269e12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33467 } }
I20260809 06:57:24.036388 317 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:24.036564 317 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:24.036752 317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:24.038928 317 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62daa14c9be9490f8784a3765e269e12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33467 } }
I20260809 06:57:24.039384 317 leader_election.cc:302] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62daa14c9be9490f8784a3765e269e12; no voters:
I20260809 06:57:24.039989 317 leader_election.cc:288] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:24.040148 327 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:24.040964 327 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [term 1 LEADER]: Becoming Leader. State: Replica: 62daa14c9be9490f8784a3765e269e12, State: Running, Role: LEADER
I20260809 06:57:24.041478 327 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62daa14c9be9490f8784a3765e269e12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33467 } }
I20260809 06:57:24.042243 317 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:24.044607 329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62daa14c9be9490f8784a3765e269e12. Latest consensus state: current_term: 1 leader_uuid: "62daa14c9be9490f8784a3765e269e12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62daa14c9be9490f8784a3765e269e12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33467 } } }
I20260809 06:57:24.045094 329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:24.047427 328 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62daa14c9be9490f8784a3765e269e12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62daa14c9be9490f8784a3765e269e12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33467 } } }
I20260809 06:57:24.047839 328 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:24.049715 332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:24.055055 332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:24.064090 332 catalog_manager.cc:1347] Generated new cluster ID: e290bf5e9a994663be8835296ce96253
I20260809 06:57:24.064232 332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:24.081624 332 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:24.083443 332 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:24.102586 332 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62daa14c9be9490f8784a3765e269e12: Generated new TSK 0
I20260809 06:57:24.103663 332 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:24.112994 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 32716
W20260809 06:57:24.114240 312 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42901
W20260809 06:57:24.114980 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 32716: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:57:24.115167 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 32716
W20260809 06:57:24.135727 32700 connection.cc:535] client connection to 127.0.0.1:33467 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33467): Connection reset by peer (error 104)
2026-08-09T06:57:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2021 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:24 dist-test-slave-0b58 krb5kdc[351](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:24 dist-test-slave-0b58 krb5kdc[351](info): set up 2 sockets
Aug 09 06:57:24 dist-test-slave-0b58 krb5kdc[351](info): commencing operation
krb5kdc: starting...
W20260809 06:57:25.267303 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.005s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:25 dist-test-slave-0b58 krb5kdc[351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:57:25.592607 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32795
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:25.936093 364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:25.936474 364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:25.936640 364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:25.943843 364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:25.944000 364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:25.944108 364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:25.944229 364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:25.944329 364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:25.954449 364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32795
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:25.955855 364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:25.957190 364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:25.969769 369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:25.969937 370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:25.969947 372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:25.970678 364 server_base.cc:1034] running on GCE node
I20260809 06:57:25.971408 364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:25.972838 364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:25.974040 364 hybrid_clock.cc:648] HybridClock initialized: now 1786258645974003 us; error 31 us; skew 500 ppm
I20260809 06:57:25.974408 364 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:25 dist-test-slave-0b58 krb5kdc[351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258645, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:25.981907 364 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:57:25.983358 364 webserver.cc:460] Webserver started at http://127.0.0.1:33671/ using document root <none> and password file <none>
I20260809 06:57:25.984062 364 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:25.984195 364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:25.984525 364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:25.987535 364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "26ce91e19bd442018b42213953cfbc90"
format_stamp: "Formatted at 2026-08-09 06:57:25 on dist-test-slave-0b58"
server_key: "5f8e5c5337a467c00e5a0fca815f549d"
server_key_iv: "1654cc041122547c62eb2f38ddebb9b6"
server_key_version: "encryptionkey@0"
I20260809 06:57:25.988374 364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "26ce91e19bd442018b42213953cfbc90"
format_stamp: "Formatted at 2026-08-09 06:57:25 on dist-test-slave-0b58"
server_key: "5f8e5c5337a467c00e5a0fca815f549d"
server_key_iv: "1654cc041122547c62eb2f38ddebb9b6"
server_key_version: "encryptionkey@0"
I20260809 06:57:25.993535 364 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 06:57:25.996948 379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:25.998242 364 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:57:25.998426 364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "26ce91e19bd442018b42213953cfbc90"
format_stamp: "Formatted at 2026-08-09 06:57:25 on dist-test-slave-0b58"
server_key: "5f8e5c5337a467c00e5a0fca815f549d"
server_key_iv: "1654cc041122547c62eb2f38ddebb9b6"
server_key_version: "encryptionkey@0"
I20260809 06:57:25.998613 364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:26.004441 364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:26.008358 364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:26.008647 364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:26.027477 364 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32795
I20260809 06:57:26.027518 432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32795 every 8 connection(s)
I20260809 06:57:26.028884 364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:26.032560 433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:26.034938 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 364
I20260809 06:57:26.035142 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:26.035683 11061 external_mini_cluster.cc:1428] Setting key 75a476791d8e4dea247025e0ab757eb7
I20260809 06:57:26.043511 436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:26.037564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53227 (local address 127.0.0.1:32795)
0809 06:57:26.038360 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:26.038371 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:26.038414 (+ 43us) server_negotiation.cc:407] Connection header received
0809 06:57:26.040040 (+ 1626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:26.040063 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:26.040454 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:26.040756 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:26.041922 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:26.041929 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:26.041941 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:26.041956 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:26.042017 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:26.042036 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:26.042225 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:26.042340 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 06:57:26.042561 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":371,"threads_started":1}
I20260809 06:57:26.045051 433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90: Bootstrap starting.
I20260809 06:57:26.047533 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:26.049006 433 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:26.050242 433 log.cc:824] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:26.053778 433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90: No bootstrap required, opened a new log
I20260809 06:57:26.055584 436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:26.053091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45729 (local address 127.0.0.1:32795)
0809 06:57:26.053283 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:26.053290 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:26.053688 (+ 398us) server_negotiation.cc:407] Connection header received
0809 06:57:26.053816 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:26.053824 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:26.053883 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:26.053983 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:26.054918 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:26.054923 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:26.054945 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:26.054964 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:26.055009 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:26.055036 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:26.055164 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:26.055243 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 06:57:26.055301 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 06:57:26.061846 433 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26ce91e19bd442018b42213953cfbc90" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32795 } }
I20260809 06:57:26.062229 433 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:26.062359 433 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26ce91e19bd442018b42213953cfbc90, State: Initialized, Role: FOLLOWER
I20260809 06:57:26.062945 433 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26ce91e19bd442018b42213953cfbc90" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32795 } }
I20260809 06:57:26.063215 433 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:26.063362 433 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:26.063503 433 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:26.066181 433 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26ce91e19bd442018b42213953cfbc90" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32795 } }
I20260809 06:57:26.066634 433 leader_election.cc:302] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26ce91e19bd442018b42213953cfbc90; no voters:
I20260809 06:57:26.067181 433 leader_election.cc:288] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:26.067322 443 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:26.068086 443 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [term 1 LEADER]: Becoming Leader. State: Replica: 26ce91e19bd442018b42213953cfbc90, State: Running, Role: LEADER
I20260809 06:57:26.068744 443 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26ce91e19bd442018b42213953cfbc90" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32795 } }
I20260809 06:57:26.069473 433 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:26.071703 445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26ce91e19bd442018b42213953cfbc90. Latest consensus state: current_term: 1 leader_uuid: "26ce91e19bd442018b42213953cfbc90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26ce91e19bd442018b42213953cfbc90" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32795 } } }
I20260809 06:57:26.071727 444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26ce91e19bd442018b42213953cfbc90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26ce91e19bd442018b42213953cfbc90" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32795 } } }
I20260809 06:57:26.072209 444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:26.074504 445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:26.075309 449 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:26.080519 449 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:26.089984 449 catalog_manager.cc:1347] Generated new cluster ID: 3676db12ea6042d4b0c18ac993630866
I20260809 06:57:26.090104 449 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:26.117417 449 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:26.117882 449 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:26.130903 449 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26ce91e19bd442018b42213953cfbc90: Generated new TSK 0
I20260809 06:57:26.131753 449 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:26.142127 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 364
W20260809 06:57:26.143450 428 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53227
W20260809 06:57:26.144205 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 364: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:57:26.144426 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 364
2026-08-09T06:57:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2029 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:26 dist-test-slave-0b58 krb5kdc[464](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:26 dist-test-slave-0b58 krb5kdc[464](info): set up 2 sockets
Aug 09 06:57:26 dist-test-slave-0b58 krb5kdc[464](info): commencing operation
krb5kdc: starting...
W20260809 06:57:27.299340 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.001s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:27 dist-test-slave-0b58 krb5kdc[464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:57:27.611553 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33785
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:27.943708 479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:27.943967 479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:27.944054 479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:27.951632 479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:27.951730 479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:27.951776 479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:27.951843 479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:27.951887 479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:27.961148 479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33785
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:27.962244 479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:27.963500 479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:27.974936 485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:27.974915 487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:27.975020 484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:27.975716 479 server_base.cc:1034] running on GCE node
I20260809 06:57:27.976548 479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:27.977839 479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:27.979041 479 hybrid_clock.cc:648] HybridClock initialized: now 1786258647979008 us; error 34 us; skew 500 ppm
I20260809 06:57:27.979358 479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:27 dist-test-slave-0b58 krb5kdc[464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258647, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:27.982491 479 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:57:27.983894 479 webserver.cc:460] Webserver started at http://127.0.0.1:34777/ using document root <none> and password file <none>
I20260809 06:57:27.984647 479 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:27.984791 479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:27.985098 479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:27.987973 479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "d807535f153c4580a96b98d1448e6b07"
format_stamp: "Formatted at 2026-08-09 06:57:27 on dist-test-slave-0b58"
server_key: "f6ef65f01bfdeaf637a13405f02e3cbf"
server_key_iv: "c7bee5ab39aec091f1af4c867b8f7514"
server_key_version: "encryptionkey@0"
I20260809 06:57:27.988799 479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "d807535f153c4580a96b98d1448e6b07"
format_stamp: "Formatted at 2026-08-09 06:57:27 on dist-test-slave-0b58"
server_key: "f6ef65f01bfdeaf637a13405f02e3cbf"
server_key_iv: "c7bee5ab39aec091f1af4c867b8f7514"
server_key_version: "encryptionkey@0"
I20260809 06:57:27.993799 479 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260809 06:57:27.997056 494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:27.998241 479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:57:27.998427 479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "d807535f153c4580a96b98d1448e6b07"
format_stamp: "Formatted at 2026-08-09 06:57:27 on dist-test-slave-0b58"
server_key: "f6ef65f01bfdeaf637a13405f02e3cbf"
server_key_iv: "c7bee5ab39aec091f1af4c867b8f7514"
server_key_version: "encryptionkey@0"
I20260809 06:57:27.998617 479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:28.011955 479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:28.015692 479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:28.015992 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:28.034633 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33785
I20260809 06:57:28.034657 546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33785 every 8 connection(s)
I20260809 06:57:28.035956 479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:28.039533 547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:28.041622 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 479
I20260809 06:57:28.041810 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:28.042387 11061 external_mini_cluster.cc:1428] Setting key dcc54fda31d7c0dc1d8b1e2fda041695
I20260809 06:57:28.053817 547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07: Bootstrap starting.
Aug 09 06:57:28 dist-test-slave-0b58 krb5kdc[464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 06:57:28.057682 547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:28.058780 547 log.cc:824] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:28.061888 547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07: No bootstrap required, opened a new log
I20260809 06:57:28.065529 550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:28.044145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41467 (local address 127.0.0.1:33785)
0809 06:57:28.045026 (+ 881us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:28.045037 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:28.045084 (+ 47us) server_negotiation.cc:407] Connection header received
0809 06:57:28.046631 (+ 1547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:28.046654 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:28.047017 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:28.047310 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:28.049249 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:28.050569 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:28.052455 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:28.053127 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:28.053249 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:28.058167 (+ 4918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:28.058174 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:28.058187 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:28.058221 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:28.061452 (+ 3231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:28.062238 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:28.062249 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:28.062255 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:28.062433 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:28.062844 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:28.062847 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:28.062849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:28.063339 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:28.063688 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:28.064129 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 06:57:28.064574 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":414,"threads_started":1}
I20260809 06:57:28.069458 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:28.070694 547 raft_consensus.cc:348] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d807535f153c4580a96b98d1448e6b07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33785 } }
I20260809 06:57:28.071059 547 raft_consensus.cc:374] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:28.071172 547 raft_consensus.cc:729] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d807535f153c4580a96b98d1448e6b07, State: Initialized, Role: FOLLOWER
I20260809 06:57:28.071743 547 consensus_queue.cc:260] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d807535f153c4580a96b98d1448e6b07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33785 } }
I20260809 06:57:28.072034 547 raft_consensus.cc:388] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:28.072180 547 raft_consensus.cc:482] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:28.072386 547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:28.075217 547 raft_consensus.cc:504] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d807535f153c4580a96b98d1448e6b07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33785 } }
I20260809 06:57:28.075690 547 leader_election.cc:302] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d807535f153c4580a96b98d1448e6b07; no voters:
I20260809 06:57:28.076367 547 leader_election.cc:288] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:28.076499 557 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:28.078299 557 raft_consensus.cc:686] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [term 1 LEADER]: Becoming Leader. State: Replica: d807535f153c4580a96b98d1448e6b07, State: Running, Role: LEADER
I20260809 06:57:28.078938 557 consensus_queue.cc:237] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d807535f153c4580a96b98d1448e6b07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33785 } }
I20260809 06:57:28.079119 547 sys_catalog.cc:564] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:28.085937 558 sys_catalog.cc:455] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d807535f153c4580a96b98d1448e6b07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d807535f153c4580a96b98d1448e6b07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33785 } } }
I20260809 06:57:28.086457 558 sys_catalog.cc:458] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:28.087092 559 sys_catalog.cc:455] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d807535f153c4580a96b98d1448e6b07. Latest consensus state: current_term: 1 leader_uuid: "d807535f153c4580a96b98d1448e6b07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d807535f153c4580a96b98d1448e6b07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33785 } } }
I20260809 06:57:28.087466 559 sys_catalog.cc:458] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:28.091881 550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:28.074020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58487 (local address 127.0.0.1:33785)
0809 06:57:28.074210 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:28.074217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:28.074560 (+ 343us) server_negotiation.cc:407] Connection header received
0809 06:57:28.074749 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:28.074754 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:28.074823 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:28.074924 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:28.076509 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:28.077918 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:28.079444 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:28.079904 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:28.080036 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:28.082749 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:28.082758 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:28.082765 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:28.082813 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:28.086730 (+ 3917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:28.087887 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:28.087896 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:28.087902 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:28.088110 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:28.088855 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:28.088862 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:28.088867 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:28.089402 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:28.090869 (+ 1467us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:28.091076 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 06:57:28.091380 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 06:57:28.097481 567 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:28.102751 567 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:28.111284 567 catalog_manager.cc:1347] Generated new cluster ID: edbdb63c66194092b17da9ad9b981668
I20260809 06:57:28.111398 567 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:28.125325 567 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:28.127159 567 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:28.136350 567 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d807535f153c4580a96b98d1448e6b07: Generated new TSK 0
I20260809 06:57:28.137341 567 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:28.148310 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 479
I20260809 06:57:28.149565 542 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:28.242928 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 479
2026-08-09T06:57:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2097 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:28 dist-test-slave-0b58 krb5kdc[581](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:28 dist-test-slave-0b58 krb5kdc[581](info): set up 2 sockets
Aug 09 06:57:28 dist-test-slave-0b58 krb5kdc[581](info): commencing operation
krb5kdc: starting...
W20260809 06:57:29.371704 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.004s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:29 dist-test-slave-0b58 krb5kdc[581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:57:29.693765 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39593
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:30.039557 594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:30.039835 594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:30.039930 594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:30.047209 594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:30.047361 594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:30.047416 594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:30.047472 594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:30.047510 594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:30.057567 594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:30.058838 594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:30.060205 594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:30.072810 601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:30.072748 603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:30.073311 600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:30.073716 594 server_base.cc:1034] running on GCE node
I20260809 06:57:30.074510 594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:30.075940 594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:30.077135 594 hybrid_clock.cc:648] HybridClock initialized: now 1786258650077053 us; error 71 us; skew 500 ppm
I20260809 06:57:30.077510 594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:30 dist-test-slave-0b58 krb5kdc[581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258650, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:30.080693 594 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:57:30.082221 594 webserver.cc:460] Webserver started at http://127.0.0.1:41213/ using document root <none> and password file <none>
I20260809 06:57:30.082924 594 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:30.083058 594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:30.083369 594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:30.086601 594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "f2b9f4e6c20f4b2b923dc4af55f5dcdf"
format_stamp: "Formatted at 2026-08-09 06:57:30 on dist-test-slave-0b58"
server_key: "6c79eb01fb35e4587246ca5a740f6b45"
server_key_iv: "16f1e21ba7845b2949356c0ad2d573e9"
server_key_version: "encryptionkey@0"
I20260809 06:57:30.087411 594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "f2b9f4e6c20f4b2b923dc4af55f5dcdf"
format_stamp: "Formatted at 2026-08-09 06:57:30 on dist-test-slave-0b58"
server_key: "6c79eb01fb35e4587246ca5a740f6b45"
server_key_iv: "16f1e21ba7845b2949356c0ad2d573e9"
server_key_version: "encryptionkey@0"
I20260809 06:57:30.092686 594 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 06:57:30.096231 611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:30.097694 594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:57:30.097916 594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "f2b9f4e6c20f4b2b923dc4af55f5dcdf"
format_stamp: "Formatted at 2026-08-09 06:57:30 on dist-test-slave-0b58"
server_key: "6c79eb01fb35e4587246ca5a740f6b45"
server_key_iv: "16f1e21ba7845b2949356c0ad2d573e9"
server_key_version: "encryptionkey@0"
I20260809 06:57:30.098242 594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:30.117177 594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:30.121444 594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:30.121773 594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:30.141018 594 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39593
I20260809 06:57:30.141076 665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39593 every 8 connection(s)
I20260809 06:57:30.142531 594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:30.145725 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 594
I20260809 06:57:30.145920 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:30.146400 11061 external_mini_cluster.cc:1428] Setting key 4653c12bd11fce72586ce0705e25416f
I20260809 06:57:30.146421 666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:30.161938 669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:30.148245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55403 (local address 127.0.0.1:39593)
0809 06:57:30.149172 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:30.149187 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:30.149251 (+ 64us) server_negotiation.cc:407] Connection header received
0809 06:57:30.151567 (+ 2316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:30.151604 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:30.152132 (+ 528us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:30.152599 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:30.153168 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:30.155202 (+ 2034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:30.156627 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:30.157714 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:30.157903 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:30.159064 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:30.159074 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:30.159092 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:30.159844 (+ 752us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:30.159948 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:30.159977 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:30.160088 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:30.160297 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 06:57:30.160585 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":370,"threads_started":1}
I20260809 06:57:30.162086 666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf: Bootstrap starting.
I20260809 06:57:30.165482 666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:30.165673 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:30.166613 666 log.cc:824] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:30.169620 666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf: No bootstrap required, opened a new log
I20260809 06:57:30.177484 669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:30.170737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47785 (local address 127.0.0.1:39593)
0809 06:57:30.170906 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:30.170912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:30.171279 (+ 367us) server_negotiation.cc:407] Connection header received
0809 06:57:30.171437 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:30.171443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:30.171529 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:30.171644 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:30.172146 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:30.173345 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:30.174710 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:30.175451 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:30.175583 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:30.176688 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:30.176695 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:30.176700 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:30.176722 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:30.176767 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:30.176787 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:30.176888 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:30.177009 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 06:57:30.177105 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:57:30.179378 666 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2b9f4e6c20f4b2b923dc4af55f5dcdf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39593 } }
I20260809 06:57:30.179781 666 raft_consensus.cc:374] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:30.179917 666 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2b9f4e6c20f4b2b923dc4af55f5dcdf, State: Initialized, Role: FOLLOWER
I20260809 06:57:30.180637 666 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2b9f4e6c20f4b2b923dc4af55f5dcdf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39593 } }
I20260809 06:57:30.180924 666 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:30.181079 666 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:30.181272 666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:30.183560 666 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2b9f4e6c20f4b2b923dc4af55f5dcdf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39593 } }
I20260809 06:57:30.184089 666 leader_election.cc:302] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2b9f4e6c20f4b2b923dc4af55f5dcdf; no voters:
I20260809 06:57:30.184755 666 leader_election.cc:288] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:30.184886 676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:30.185681 676 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [term 1 LEADER]: Becoming Leader. State: Replica: f2b9f4e6c20f4b2b923dc4af55f5dcdf, State: Running, Role: LEADER
I20260809 06:57:30.186323 676 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2b9f4e6c20f4b2b923dc4af55f5dcdf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39593 } }
I20260809 06:57:30.187173 666 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:30.189249 678 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2b9f4e6c20f4b2b923dc4af55f5dcdf. Latest consensus state: current_term: 1 leader_uuid: "f2b9f4e6c20f4b2b923dc4af55f5dcdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2b9f4e6c20f4b2b923dc4af55f5dcdf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39593 } } }
I20260809 06:57:30.189328 677 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2b9f4e6c20f4b2b923dc4af55f5dcdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2b9f4e6c20f4b2b923dc4af55f5dcdf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39593 } } }
I20260809 06:57:30.189664 678 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:30.189735 677 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:30.190732 682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:30.197286 682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:30.206799 682 catalog_manager.cc:1347] Generated new cluster ID: cd6ed7cf5bfe48eb8c7ed1a244e78118
I20260809 06:57:30.206911 682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:30.234215 682 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:30.236369 682 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:30.251902 682 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f2b9f4e6c20f4b2b923dc4af55f5dcdf: Generated new TSK 0
I20260809 06:57:30.252939 682 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:30.266875 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 594
W20260809 06:57:30.268055 661 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55403
W20260809 06:57:30.268865 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 594: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:57:30.269047 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 594
2026-08-09T06:57:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2026 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:30 dist-test-slave-0b58 krb5kdc[697](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:30 dist-test-slave-0b58 krb5kdc[697](info): set up 2 sockets
Aug 09 06:57:30 dist-test-slave-0b58 krb5kdc[697](info): commencing operation
krb5kdc: starting...
W20260809 06:57:31.439394 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:31 dist-test-slave-0b58 krb5kdc[697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:57:31.771417 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33697
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:32.137710 711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:32.138028 711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:32.138229 711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:32.145905 711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:32.146021 711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:32.146071 711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:32.146180 711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:32.146258 711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:32.157058 711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33697
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:32.158535 711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:32.159961 711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:32.172001 716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:32.172091 717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:32.172055 719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:32.172892 711 server_base.cc:1034] running on GCE node
I20260809 06:57:32.173902 711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:32.175369 711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:32.176621 711 hybrid_clock.cc:648] HybridClock initialized: now 1786258652176582 us; error 49 us; skew 500 ppm
I20260809 06:57:32.176990 711 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:32 dist-test-slave-0b58 krb5kdc[697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258652, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:32.180099 711 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:57:32.181733 711 webserver.cc:460] Webserver started at http://127.0.0.1:46391/ using document root <none> and password file <none>
I20260809 06:57:32.182430 711 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:32.182590 711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:32.182915 711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:32.186224 711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "e2ad9bd739f74601a090fd534958c830"
format_stamp: "Formatted at 2026-08-09 06:57:32 on dist-test-slave-0b58"
server_key: "16d6b5f0f60cd43dbc6a3c5b363c4b51"
server_key_iv: "58565c4b91e497b10f88b53a983ab650"
server_key_version: "encryptionkey@0"
I20260809 06:57:32.187031 711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "e2ad9bd739f74601a090fd534958c830"
format_stamp: "Formatted at 2026-08-09 06:57:32 on dist-test-slave-0b58"
server_key: "16d6b5f0f60cd43dbc6a3c5b363c4b51"
server_key_iv: "58565c4b91e497b10f88b53a983ab650"
server_key_version: "encryptionkey@0"
I20260809 06:57:32.192203 711 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 06:57:32.195644 726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:32.196983 711 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:57:32.197183 711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "e2ad9bd739f74601a090fd534958c830"
format_stamp: "Formatted at 2026-08-09 06:57:32 on dist-test-slave-0b58"
server_key: "16d6b5f0f60cd43dbc6a3c5b363c4b51"
server_key_iv: "58565c4b91e497b10f88b53a983ab650"
server_key_version: "encryptionkey@0"
I20260809 06:57:32.197388 711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:32.203277 711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:32.207412 711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:32.207763 711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:32.227386 711 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33697
I20260809 06:57:32.227468 779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33697 every 8 connection(s)
I20260809 06:57:32.229327 711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:32.234004 780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:32.235930 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 711
I20260809 06:57:32.236106 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:32.236660 11061 external_mini_cluster.cc:1428] Setting key 3cfc9fdadc26fe17964016711c16617b
I20260809 06:57:32.249820 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:32.238856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43585 (local address 127.0.0.1:33697)
0809 06:57:32.239839 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:32.239855 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:32.239911 (+ 56us) server_negotiation.cc:407] Connection header received
0809 06:57:32.243182 (+ 3271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:32.243213 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:32.243680 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:32.244103 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:32.247196 (+ 3093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:32.247205 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:32.247222 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:32.247243 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:32.247327 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:32.247354 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:32.248028 (+ 674us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:32.248185 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 06:57:32.248429 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":434,"threads_started":1}
I20260809 06:57:32.252141 780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830: Bootstrap starting.
I20260809 06:57:32.253979 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:32.255817 780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:32.257227 780 log.cc:824] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:32.261019 780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830: No bootstrap required, opened a new log
I20260809 06:57:32.262405 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:32.259680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38215 (local address 127.0.0.1:33697)
0809 06:57:32.259916 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:32.259922 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:32.260317 (+ 395us) server_negotiation.cc:407] Connection header received
0809 06:57:32.260535 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:32.260539 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:32.260592 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:32.260673 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:32.261713 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:32.261717 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:32.261720 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:32.261734 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:32.261772 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:32.261787 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:32.261873 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:32.262032 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 06:57:32.262079 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 06:57:32.268971 780 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ad9bd739f74601a090fd534958c830" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } }
I20260809 06:57:32.269379 780 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:32.269534 780 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2ad9bd739f74601a090fd534958c830, State: Initialized, Role: FOLLOWER
I20260809 06:57:32.270195 780 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ad9bd739f74601a090fd534958c830" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } }
I20260809 06:57:32.270484 780 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:32.270648 780 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:32.270820 780 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:32.273284 780 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ad9bd739f74601a090fd534958c830" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } }
I20260809 06:57:32.273800 780 leader_election.cc:302] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2ad9bd739f74601a090fd534958c830; no voters:
I20260809 06:57:32.274372 780 leader_election.cc:288] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:32.274518 790 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:32.275230 790 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [term 1 LEADER]: Becoming Leader. State: Replica: e2ad9bd739f74601a090fd534958c830, State: Running, Role: LEADER
I20260809 06:57:32.275784 790 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ad9bd739f74601a090fd534958c830" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } }
I20260809 06:57:32.276540 780 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:32.278409 791 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2ad9bd739f74601a090fd534958c830" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ad9bd739f74601a090fd534958c830" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } } }
I20260809 06:57:32.278779 791 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:32.279785 797 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:32.279567 793 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2ad9bd739f74601a090fd534958c830. Latest consensus state: current_term: 1 leader_uuid: "e2ad9bd739f74601a090fd534958c830" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2ad9bd739f74601a090fd534958c830" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } } }
I20260809 06:57:32.279948 793 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:32.286391 797 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:32.294950 797 catalog_manager.cc:1347] Generated new cluster ID: 84c894c86503402c9803840086881cbd
I20260809 06:57:32.295073 797 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:32.308324 797 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:32.308841 797 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:32.319864 797 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2ad9bd739f74601a090fd534958c830: Generated new TSK 0
I20260809 06:57:32.320937 797 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:32.330673 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 711
W20260809 06:57:32.332451 775 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43585
W20260809 06:57:32.333164 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 711: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:57:32.333324 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 711
2026-08-09T06:57:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2064 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:32 dist-test-slave-0b58 krb5kdc[812](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:32 dist-test-slave-0b58 krb5kdc[812](info): set up 2 sockets
Aug 09 06:57:32 dist-test-slave-0b58 krb5kdc[812](info): commencing operation
krb5kdc: starting...
W20260809 06:57:33.470629 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:33 dist-test-slave-0b58 krb5kdc[812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:57:33.797461 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37421
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:34.140244 826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:34.140575 826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:34.140758 826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:34.147735 826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:34.147876 826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:34.147984 826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:34.148082 826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:34.148173 826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:34.157783 826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:34.159093 826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:34.160502 826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:34.172219 831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:34.172246 832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:34.172308 834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:34.173105 826 server_base.cc:1034] running on GCE node
I20260809 06:57:34.173959 826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:34.175377 826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:34.176618 826 hybrid_clock.cc:648] HybridClock initialized: now 1786258654176573 us; error 50 us; skew 500 ppm
I20260809 06:57:34.176999 826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:34 dist-test-slave-0b58 krb5kdc[812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258654, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:34.180207 826 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:57:34.181948 826 webserver.cc:460] Webserver started at http://127.0.0.1:45877/ using document root <none> and password file <none>
I20260809 06:57:34.182660 826 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:34.182780 826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:34.183053 826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:34.186393 826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "142e43a075664d188e3cce4d15638665"
format_stamp: "Formatted at 2026-08-09 06:57:34 on dist-test-slave-0b58"
server_key: "49b2b76491cc393da77d4b3cb91eb155"
server_key_iv: "47cce1a2155cb4e7cb19ad340ed7f6e0"
server_key_version: "encryptionkey@0"
I20260809 06:57:34.187178 826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "142e43a075664d188e3cce4d15638665"
format_stamp: "Formatted at 2026-08-09 06:57:34 on dist-test-slave-0b58"
server_key: "49b2b76491cc393da77d4b3cb91eb155"
server_key_iv: "47cce1a2155cb4e7cb19ad340ed7f6e0"
server_key_version: "encryptionkey@0"
I20260809 06:57:34.192826 826 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 06:57:34.196460 841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:34.197885 826 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:57:34.198084 826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "142e43a075664d188e3cce4d15638665"
format_stamp: "Formatted at 2026-08-09 06:57:34 on dist-test-slave-0b58"
server_key: "49b2b76491cc393da77d4b3cb91eb155"
server_key_iv: "47cce1a2155cb4e7cb19ad340ed7f6e0"
server_key_version: "encryptionkey@0"
I20260809 06:57:34.198312 826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:34.217213 826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:34.221129 826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:34.221364 826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:34.242818 826 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37421
I20260809 06:57:34.242841 895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37421 every 8 connection(s)
I20260809 06:57:34.244344 826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:34.247964 896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:34.249356 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 826
I20260809 06:57:34.249531 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:34.250097 11061 external_mini_cluster.cc:1428] Setting key 63989d4ebbe613178d57611693349b7f
I20260809 06:57:34.262408 896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665: Bootstrap starting.
Aug 09 06:57:34 dist-test-slave-0b58 krb5kdc[812](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 06:57:34.266055 896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:34.267179 896 log.cc:824] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:34.270078 896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665: No bootstrap required, opened a new log
I20260809 06:57:34.273729 899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:34.252009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:48487 (local address 127.0.0.1:37421)
0809 06:57:34.252821 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:34.252832 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:34.252875 (+ 43us) server_negotiation.cc:407] Connection header received
0809 06:57:34.254500 (+ 1625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:34.254539 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:34.254954 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:34.255283 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:34.257107 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:34.258388 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:34.260216 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:34.260917 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:34.261038 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:34.265911 (+ 4873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:34.265918 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:34.265935 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:34.265989 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:34.269301 (+ 3312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:34.270093 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:34.270100 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:34.270106 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:34.270322 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:34.270844 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:34.270847 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:34.270849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:34.271351 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:34.271736 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:34.272306 (+ 570us) server_negotiation.cc:299] Negotiation successful
0809 06:57:34.272620 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":381,"threads_started":1}
I20260809 06:57:34.277627 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:34.278510 896 raft_consensus.cc:348] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e43a075664d188e3cce4d15638665" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37421 } }
I20260809 06:57:34.278884 896 raft_consensus.cc:374] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:34.279008 896 raft_consensus.cc:729] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 142e43a075664d188e3cce4d15638665, State: Initialized, Role: FOLLOWER
I20260809 06:57:34.279541 896 consensus_queue.cc:260] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e43a075664d188e3cce4d15638665" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37421 } }
I20260809 06:57:34.279744 896 raft_consensus.cc:388] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:34.279923 896 raft_consensus.cc:482] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:34.280076 896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:34.282768 896 raft_consensus.cc:504] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e43a075664d188e3cce4d15638665" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37421 } }
I20260809 06:57:34.283262 896 leader_election.cc:302] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 142e43a075664d188e3cce4d15638665; no voters:
I20260809 06:57:34.283907 896 leader_election.cc:288] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:34.284142 906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:34.285915 896 sys_catalog.cc:564] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:34.288880 906 raft_consensus.cc:686] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [term 1 LEADER]: Becoming Leader. State: Replica: 142e43a075664d188e3cce4d15638665, State: Running, Role: LEADER
I20260809 06:57:34.289683 906 consensus_queue.cc:237] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e43a075664d188e3cce4d15638665" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37421 } }
I20260809 06:57:34.293385 907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "142e43a075664d188e3cce4d15638665" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e43a075664d188e3cce4d15638665" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37421 } } }
I20260809 06:57:34.293860 907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:34.294476 908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 142e43a075664d188e3cce4d15638665. Latest consensus state: current_term: 1 leader_uuid: "142e43a075664d188e3cce4d15638665" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e43a075664d188e3cce4d15638665" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37421 } } }
I20260809 06:57:34.294827 908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:34.304883 915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:34.312505 915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:34.318069 899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:34.282362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:38277 (local address 127.0.0.1:37421)
0809 06:57:34.282558 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:34.282566 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:34.297543 (+ 14977us) server_negotiation.cc:407] Connection header received
0809 06:57:34.298160 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:34.298169 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:34.298280 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:34.298371 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:34.301035 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:34.303016 (+ 1981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:34.304963 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:34.305785 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:34.305927 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:34.309115 (+ 3188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:34.309122 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:34.309128 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:34.309178 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:34.313519 (+ 4341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:34.314630 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:34.314636 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:34.314639 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:34.314806 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:34.315394 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:34.315399 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:34.315403 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:34.315821 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:34.316121 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:34.317455 (+ 1334us) server_negotiation.cc:299] Negotiation successful
0809 06:57:34.317659 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:57:34.324102 915 catalog_manager.cc:1347] Generated new cluster ID: bcf36a60bb12480ca4b636f6ac79562f
I20260809 06:57:34.324227 915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:34.348567 915 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:34.349821 915 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:34.359750 915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 142e43a075664d188e3cce4d15638665: Generated new TSK 0
I20260809 06:57:34.360821 915 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:34.369237 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 826
I20260809 06:57:34.370476 891 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:34.463776 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 826
W20260809 06:57:34.484395 810 connection.cc:535] client connection to 127.0.0.1:37421 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37421): Connection reset by peer (error 104)
2026-08-09T06:57:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2129 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:34 dist-test-slave-0b58 krb5kdc[929](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:34 dist-test-slave-0b58 krb5kdc[929](info): set up 2 sockets
Aug 09 06:57:34 dist-test-slave-0b58 krb5kdc[929](info): commencing operation
krb5kdc: starting...
W20260809 06:57:35.611377 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.004s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:35 dist-test-slave-0b58 krb5kdc[929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:57:35.939509 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42317
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:36.290306 942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:36.290601 942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:36.290731 942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:36.297765 942 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:36.297899 942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:36.297945 942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:36.298039 942 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:36.298141 942 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:36.308210 942 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:36.309651 942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:36.310983 942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:36.322767 947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:36.322737 950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:36.322911 948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:36.330091 942 server_base.cc:1034] running on GCE node
I20260809 06:57:36.331152 942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:36.332894 942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:36.334123 942 hybrid_clock.cc:648] HybridClock initialized: now 1786258656334078 us; error 31 us; skew 500 ppm
I20260809 06:57:36.334535 942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:36 dist-test-slave-0b58 krb5kdc[929](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258656, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:36.338220 942 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:57:36.340026 942 webserver.cc:460] Webserver started at http://127.0.0.1:45689/ using document root <none> and password file <none>
I20260809 06:57:36.340834 942 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:36.341029 942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:36.341387 942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:36.344739 942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "b6fb327e26274074bc93238cb6f447db"
format_stamp: "Formatted at 2026-08-09 06:57:36 on dist-test-slave-0b58"
server_key: "109459a8c63863a4b819adba388ca493"
server_key_iv: "469ca1aac8b724385d396a34d290a4a1"
server_key_version: "encryptionkey@0"
I20260809 06:57:36.345602 942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "b6fb327e26274074bc93238cb6f447db"
format_stamp: "Formatted at 2026-08-09 06:57:36 on dist-test-slave-0b58"
server_key: "109459a8c63863a4b819adba388ca493"
server_key_iv: "469ca1aac8b724385d396a34d290a4a1"
server_key_version: "encryptionkey@0"
I20260809 06:57:36.351284 942 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:57:36.355170 957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:36.356997 942 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 06:57:36.357224 942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "b6fb327e26274074bc93238cb6f447db"
format_stamp: "Formatted at 2026-08-09 06:57:36 on dist-test-slave-0b58"
server_key: "109459a8c63863a4b819adba388ca493"
server_key_iv: "469ca1aac8b724385d396a34d290a4a1"
server_key_version: "encryptionkey@0"
I20260809 06:57:36.357425 942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:36.374788 942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:36.379520 942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:36.379922 942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:36.403080 942 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42317
I20260809 06:57:36.403128 1013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42317 every 8 connection(s)
I20260809 06:57:36.404748 942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:36.408417 1014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:36.413646 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 942
I20260809 06:57:36.413848 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:36.414386 11061 external_mini_cluster.cc:1428] Setting key 3abe7382ec12498e9233879012a68eb9
I20260809 06:57:36.420424 1014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db: Bootstrap starting.
I20260809 06:57:36.424508 1014 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:36.425694 1014 log.cc:824] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:36.428985 1014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db: No bootstrap required, opened a new log
I20260809 06:57:36.430388 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:36.416399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:58779 (local address 127.0.0.1:42317)
0809 06:57:36.417323 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:36.417357 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:36.417410 (+ 53us) server_negotiation.cc:407] Connection header received
0809 06:57:36.419888 (+ 2478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:36.419922 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:36.420496 (+ 574us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:36.420939 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:36.421479 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:36.423572 (+ 2093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:36.425248 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:36.426417 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:36.426657 (+ 240us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:36.428022 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:36.428030 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:36.428043 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:36.428636 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:36.428709 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:36.428734 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:36.428919 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:36.429182 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 06:57:36.429371 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":388,"threads_started":1}
I20260809 06:57:36.434455 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:36.437616 1014 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6fb327e26274074bc93238cb6f447db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42317 } }
I20260809 06:57:36.438056 1014 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:36.438166 1014 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6fb327e26274074bc93238cb6f447db, State: Initialized, Role: FOLLOWER
I20260809 06:57:36.438824 1014 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6fb327e26274074bc93238cb6f447db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42317 } }
I20260809 06:57:36.439141 1014 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:36.439354 1014 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:36.439554 1014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:36.442900 1014 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6fb327e26274074bc93238cb6f447db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42317 } }
I20260809 06:57:36.443547 1014 leader_election.cc:302] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6fb327e26274074bc93238cb6f447db; no voters:
I20260809 06:57:36.444391 1014 leader_election.cc:288] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:36.444531 1024 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:36.445699 1024 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [term 1 LEADER]: Becoming Leader. State: Replica: b6fb327e26274074bc93238cb6f447db, State: Running, Role: LEADER
I20260809 06:57:36.446519 1017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:36.439162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:43433 (local address 127.0.0.1:42317)
0809 06:57:36.439374 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:36.439379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:36.439723 (+ 344us) server_negotiation.cc:407] Connection header received
0809 06:57:36.440010 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:36.440014 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:36.440076 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:36.440151 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:36.440873 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:36.441637 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:36.443507 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:36.444050 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:36.444192 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:36.445523 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:36.445532 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:36.445539 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:36.445569 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:36.445639 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:36.445668 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:36.445806 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:36.446082 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 06:57:36.446149 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 06:57:36.446440 1024 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6fb327e26274074bc93238cb6f447db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42317 } }
I20260809 06:57:36.447031 1014 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:36.449752 1026 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6fb327e26274074bc93238cb6f447db. Latest consensus state: current_term: 1 leader_uuid: "b6fb327e26274074bc93238cb6f447db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6fb327e26274074bc93238cb6f447db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42317 } } }
I20260809 06:57:36.450197 1026 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:36.450773 1025 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6fb327e26274074bc93238cb6f447db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6fb327e26274074bc93238cb6f447db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42317 } } }
I20260809 06:57:36.451159 1025 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:36.457371 1029 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:36.464432 1029 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:36.473958 1029 catalog_manager.cc:1347] Generated new cluster ID: b47f3d2715114e189c9db4453330a579
I20260809 06:57:36.474098 1029 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:36.494310 1029 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:36.496237 1029 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:36.506408 1029 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6fb327e26274074bc93238cb6f447db: Generated new TSK 0
I20260809 06:57:36.507455 1029 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:36.515703 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 942
W20260809 06:57:36.516987 1008 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.101:58779
W20260809 06:57:36.517870 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 942: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:57:36.518034 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 942
W20260809 06:57:36.538847 927 connection.cc:535] client connection to 127.0.0.1:42317 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42317): Connection reset by peer (error 104)
2026-08-09T06:57:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2054 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:36 dist-test-slave-0b58 krb5kdc[1045](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:36 dist-test-slave-0b58 krb5kdc[1045](info): set up 2 sockets
Aug 09 06:57:36 dist-test-slave-0b58 krb5kdc[1045](info): commencing operation
krb5kdc: starting...
W20260809 06:57:37.663094 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:37 dist-test-slave-0b58 krb5kdc[1045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:57:37.989560 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39727
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:38.330355 1059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:38.330695 1059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:38.330879 1059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:38.337918 1059 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:38.338090 1059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:38.338232 1059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:38.338340 1059 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:38.338426 1059 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:38.348276 1059 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:38.349678 1059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:38.350921 1059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:38.362438 1064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:38.362491 1065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:38.362555 1067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:38.363375 1059 server_base.cc:1034] running on GCE node
I20260809 06:57:38.364144 1059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:38.365599 1059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:38.366807 1059 hybrid_clock.cc:648] HybridClock initialized: now 1786258658366771 us; error 23 us; skew 500 ppm
I20260809 06:57:38.367157 1059 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:38 dist-test-slave-0b58 krb5kdc[1045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258658, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:38.376507 1059 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:57:38.377988 1059 webserver.cc:460] Webserver started at http://127.0.0.1:45691/ using document root <none> and password file <none>
I20260809 06:57:38.378664 1059 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:38.378818 1059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:38.379110 1059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:38.381924 1059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "c047b95e529848e5a6d413c744e4af54"
format_stamp: "Formatted at 2026-08-09 06:57:38 on dist-test-slave-0b58"
server_key: "ab32360247918c31ccd2a318dc200f86"
server_key_iv: "e41962ef99e6c2bdbcd865a4bd0d51be"
server_key_version: "encryptionkey@0"
I20260809 06:57:38.382721 1059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "c047b95e529848e5a6d413c744e4af54"
format_stamp: "Formatted at 2026-08-09 06:57:38 on dist-test-slave-0b58"
server_key: "ab32360247918c31ccd2a318dc200f86"
server_key_iv: "e41962ef99e6c2bdbcd865a4bd0d51be"
server_key_version: "encryptionkey@0"
I20260809 06:57:38.387768 1059 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 06:57:38.391243 1074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:38.392536 1059 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 06:57:38.392732 1059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "c047b95e529848e5a6d413c744e4af54"
format_stamp: "Formatted at 2026-08-09 06:57:38 on dist-test-slave-0b58"
server_key: "ab32360247918c31ccd2a318dc200f86"
server_key_iv: "e41962ef99e6c2bdbcd865a4bd0d51be"
server_key_version: "encryptionkey@0"
I20260809 06:57:38.392932 1059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:38.398499 1059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:38.402442 1059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:38.402738 1059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:38.421617 1059 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39727
I20260809 06:57:38.421672 1127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39727 every 8 connection(s)
I20260809 06:57:38.423091 1059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:38.426827 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:38.430620 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 1059
I20260809 06:57:38.430840 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:38.431265 11061 external_mini_cluster.cc:1428] Setting key 81181c286dbba61be6f88932f60a25ac
I20260809 06:57:38.439239 1131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:38.433326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:49179 (local address 127.0.0.1:39727)
0809 06:57:38.434091 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:38.434102 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:38.434142 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:57:38.435793 (+ 1651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:38.435813 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:38.436142 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:38.436613 (+ 471us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:38.437681 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:38.437691 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:38.437702 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:38.437716 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:38.437769 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:38.437787 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:38.438017 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:38.438165 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 06:57:38.438343 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":332,"threads_started":1}
I20260809 06:57:38.439548 1128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54: Bootstrap starting.
I20260809 06:57:38.442816 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:38.442843 1128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:38.443858 1128 log.cc:824] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:38.446748 1128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54: No bootstrap required, opened a new log
I20260809 06:57:38.449935 1131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:38.447252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:44677 (local address 127.0.0.1:39727)
0809 06:57:38.447446 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:38.447451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:38.447954 (+ 503us) server_negotiation.cc:407] Connection header received
0809 06:57:38.448075 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:38.448079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:38.448136 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:38.448243 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:38.449224 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:38.449230 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:38.449234 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:38.449252 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:38.449315 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:38.449335 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:38.449456 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:38.449549 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 06:57:38.449610 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:57:38.455134 1128 raft_consensus.cc:348] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c047b95e529848e5a6d413c744e4af54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39727 } }
I20260809 06:57:38.455552 1128 raft_consensus.cc:374] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:38.455662 1128 raft_consensus.cc:729] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c047b95e529848e5a6d413c744e4af54, State: Initialized, Role: FOLLOWER
I20260809 06:57:38.456221 1128 consensus_queue.cc:260] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c047b95e529848e5a6d413c744e4af54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39727 } }
I20260809 06:57:38.456519 1128 raft_consensus.cc:388] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:38.456655 1128 raft_consensus.cc:482] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:38.456847 1128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:38.459272 1128 raft_consensus.cc:504] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c047b95e529848e5a6d413c744e4af54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39727 } }
I20260809 06:57:38.459709 1128 leader_election.cc:302] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c047b95e529848e5a6d413c744e4af54; no voters:
I20260809 06:57:38.460325 1128 leader_election.cc:288] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:38.460461 1138 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:38.461808 1138 raft_consensus.cc:686] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [term 1 LEADER]: Becoming Leader. State: Replica: c047b95e529848e5a6d413c744e4af54, State: Running, Role: LEADER
I20260809 06:57:38.462296 1138 consensus_queue.cc:237] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c047b95e529848e5a6d413c744e4af54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39727 } }
I20260809 06:57:38.462510 1128 sys_catalog.cc:564] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:38.465260 1140 sys_catalog.cc:455] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c047b95e529848e5a6d413c744e4af54. Latest consensus state: current_term: 1 leader_uuid: "c047b95e529848e5a6d413c744e4af54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c047b95e529848e5a6d413c744e4af54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39727 } } }
I20260809 06:57:38.465360 1139 sys_catalog.cc:455] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c047b95e529848e5a6d413c744e4af54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c047b95e529848e5a6d413c744e4af54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39727 } } }
I20260809 06:57:38.465669 1140 sys_catalog.cc:458] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:38.465745 1139 sys_catalog.cc:458] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:38.468971 1145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:38.475044 1145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:38.483708 1145 catalog_manager.cc:1347] Generated new cluster ID: 57557283ae644908b6fa1b562588c056
I20260809 06:57:38.483865 1145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:38.509390 1145 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:38.509832 1145 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:38.516584 1145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c047b95e529848e5a6d413c744e4af54: Generated new TSK 0
I20260809 06:57:38.517379 1145 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:38.526820 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1059
W20260809 06:57:38.528209 1123 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.101:49179
W20260809 06:57:38.529072 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1059: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:57:38.529299 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 1059
2026-08-09T06:57:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2010 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:38 dist-test-slave-0b58 krb5kdc[1161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:38 dist-test-slave-0b58 krb5kdc[1161](info): set up 2 sockets
Aug 09 06:57:38 dist-test-slave-0b58 krb5kdc[1161](info): commencing operation
krb5kdc: starting...
W20260809 06:57:39.679762 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:39 dist-test-slave-0b58 krb5kdc[1161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:57:40.017145 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42361
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42361
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:40.368649 1174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:40.368956 1174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:40.369158 1174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:40.376459 1174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:40.376569 1174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:40.376643 1174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:40.376753 1174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:40.376822 1174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:40.386533 1174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42361
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:40.387895 1174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:40.389330 1174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:40.401473 1180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:40.401561 1182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:40.401538 1179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:40.402426 1174 server_base.cc:1034] running on GCE node
I20260809 06:57:40.403216 1174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:40.404685 1174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:40.405921 1174 hybrid_clock.cc:648] HybridClock initialized: now 1786258660405878 us; error 31 us; skew 500 ppm
I20260809 06:57:40.406296 1174 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:40 dist-test-slave-0b58 krb5kdc[1161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258660, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:40.409592 1174 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:57:40.411219 1174 webserver.cc:460] Webserver started at http://127.0.0.1:38019/ using document root <none> and password file <none>
I20260809 06:57:40.411898 1174 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:40.412035 1174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:40.412416 1174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:40.415441 1174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "6332de8ad85640db8afa37ae2c170635"
format_stamp: "Formatted at 2026-08-09 06:57:40 on dist-test-slave-0b58"
server_key: "9c45771af045d5d08f4c21dec6f2a7ac"
server_key_iv: "5ef2d6ee2f57f521c30bfa1edab5c7ee"
server_key_version: "encryptionkey@0"
I20260809 06:57:40.416227 1174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "6332de8ad85640db8afa37ae2c170635"
format_stamp: "Formatted at 2026-08-09 06:57:40 on dist-test-slave-0b58"
server_key: "9c45771af045d5d08f4c21dec6f2a7ac"
server_key_iv: "5ef2d6ee2f57f521c30bfa1edab5c7ee"
server_key_version: "encryptionkey@0"
I20260809 06:57:40.421571 1174 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 06:57:40.425186 1189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:40.426568 1174 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 06:57:40.426769 1174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "6332de8ad85640db8afa37ae2c170635"
format_stamp: "Formatted at 2026-08-09 06:57:40 on dist-test-slave-0b58"
server_key: "9c45771af045d5d08f4c21dec6f2a7ac"
server_key_iv: "5ef2d6ee2f57f521c30bfa1edab5c7ee"
server_key_version: "encryptionkey@0"
I20260809 06:57:40.426975 1174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:40.440840 1174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:40.444875 1174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:40.445195 1174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:40.464277 1174 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42361
I20260809 06:57:40.464401 1243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42361 every 8 connection(s)
I20260809 06:57:40.465845 1174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:40.469646 1244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:40.471993 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 1174
I20260809 06:57:40.472249 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:40.472765 11061 external_mini_cluster.cc:1428] Setting key b66f5d30da6ffffaa5660bf4ecd88d86
I20260809 06:57:40.482127 1244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635: Bootstrap starting.
I20260809 06:57:40.486249 1244 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:40.487663 1244 log.cc:824] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:57:40 dist-test-slave-0b58 krb5kdc[1161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 06:57:40.491228 1244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635: No bootstrap required, opened a new log
I20260809 06:57:40.498322 1247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:40.474636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:51717 (local address 127.0.0.1:42361)
0809 06:57:40.475525 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:40.475537 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:40.475581 (+ 44us) server_negotiation.cc:407] Connection header received
0809 06:57:40.477365 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:40.477388 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:40.477836 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:40.478177 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:40.480166 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:40.481592 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:40.483392 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:40.484224 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:40.484430 (+ 206us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:40.490082 (+ 5652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:40.490090 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:40.490105 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:40.490151 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:40.493587 (+ 3436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:40.494687 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:40.494697 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:40.494703 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:40.494882 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:40.495390 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:40.495394 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:40.495396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:40.496003 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:40.496302 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:40.496848 (+ 546us) server_negotiation.cc:299] Negotiation successful
0809 06:57:40.497192 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":412,"threads_started":1}
I20260809 06:57:40.500962 1244 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6332de8ad85640db8afa37ae2c170635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42361 } }
I20260809 06:57:40.501451 1244 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:40.501567 1244 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6332de8ad85640db8afa37ae2c170635, State: Initialized, Role: FOLLOWER
I20260809 06:57:40.502202 1244 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6332de8ad85640db8afa37ae2c170635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42361 } }
I20260809 06:57:40.502506 1244 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:40.502678 1244 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:40.502770 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:40.502857 1244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:40.506135 1244 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6332de8ad85640db8afa37ae2c170635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42361 } }
I20260809 06:57:40.506910 1244 leader_election.cc:302] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6332de8ad85640db8afa37ae2c170635; no voters:
I20260809 06:57:40.507591 1244 leader_election.cc:288] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:40.507697 1253 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:40.510146 1244 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:40.514951 1253 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [term 1 LEADER]: Becoming Leader. State: Replica: 6332de8ad85640db8afa37ae2c170635, State: Running, Role: LEADER
I20260809 06:57:40.515832 1253 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6332de8ad85640db8afa37ae2c170635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42361 } }
I20260809 06:57:40.518960 1254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6332de8ad85640db8afa37ae2c170635" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6332de8ad85640db8afa37ae2c170635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42361 } } }
I20260809 06:57:40.519388 1254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:40.519968 1255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6332de8ad85640db8afa37ae2c170635. Latest consensus state: current_term: 1 leader_uuid: "6332de8ad85640db8afa37ae2c170635" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6332de8ad85640db8afa37ae2c170635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42361 } } }
I20260809 06:57:40.520552 1255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:40.530560 1267 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:40.536589 1267 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:40.542654 1247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:40.508558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:50435 (local address 127.0.0.1:42361)
0809 06:57:40.508802 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:40.508811 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:40.515538 (+ 6727us) server_negotiation.cc:407] Connection header received
0809 06:57:40.516083 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:40.516093 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:40.516189 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:40.516311 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:40.518974 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:40.525193 (+ 6219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:40.527785 (+ 2592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:40.528964 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:40.529113 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:40.533545 (+ 4432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:40.533550 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:40.533553 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:40.533588 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:40.537742 (+ 4154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:40.539218 (+ 1476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:40.539227 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:40.539233 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:40.539468 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:40.540247 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:40.540255 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:40.540261 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:40.540849 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:40.541118 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:40.542093 (+ 975us) server_negotiation.cc:299] Negotiation successful
0809 06:57:40.542291 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:57:40.546859 1267 catalog_manager.cc:1347] Generated new cluster ID: ac94a55ae348497098502d708ff406ad
I20260809 06:57:40.546972 1267 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:40.565213 1267 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:40.566520 1267 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:40.582942 1267 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6332de8ad85640db8afa37ae2c170635: Generated new TSK 0
I20260809 06:57:40.583802 1267 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:40.596506 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1174
I20260809 06:57:40.597808 1238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:40.691148 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 1174
W20260809 06:57:40.713189 1159 connection.cc:535] client connection to 127.0.0.1:42361 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42361): Connection reset by peer (error 104)
2026-08-09T06:57:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2163 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:40 dist-test-slave-0b58 krb5kdc[1278](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:40 dist-test-slave-0b58 krb5kdc[1278](info): set up 2 sockets
Aug 09 06:57:40 dist-test-slave-0b58 krb5kdc[1278](info): commencing operation
krb5kdc: starting...
W20260809 06:57:41.843510 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.007s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:42 dist-test-slave-0b58 krb5kdc[1278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:57:42.183863 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45177
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45177
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:42.535501 1291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:42.535796 1291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:42.535980 1291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:42.543538 1291 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:42.543672 1291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:42.543763 1291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:42.543902 1291 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:42.543983 1291 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:42.554311 1291 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45177
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:42.555745 1291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:42.557238 1291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:42.569782 1296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:42.569730 1297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:42.569882 1300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:42.571002 1291 server_base.cc:1034] running on GCE node
I20260809 06:57:42.571808 1291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:42.573400 1291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:42.574609 1291 hybrid_clock.cc:648] HybridClock initialized: now 1786258662574564 us; error 39 us; skew 500 ppm
I20260809 06:57:42.574985 1291 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:42 dist-test-slave-0b58 krb5kdc[1278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258662, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:42.578125 1291 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:57:42.579691 1291 webserver.cc:460] Webserver started at http://127.0.0.1:44529/ using document root <none> and password file <none>
I20260809 06:57:42.580470 1291 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:42.580623 1291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:42.580953 1291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:42.584101 1291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "781f06b97f0545229af8455adb3802f3"
format_stamp: "Formatted at 2026-08-09 06:57:42 on dist-test-slave-0b58"
server_key: "cb8a0076a6acc9afe97b08cf7b41bd4b"
server_key_iv: "79727c52a7f005cac96fa595ea3a7992"
server_key_version: "encryptionkey@0"
I20260809 06:57:42.585017 1291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "781f06b97f0545229af8455adb3802f3"
format_stamp: "Formatted at 2026-08-09 06:57:42 on dist-test-slave-0b58"
server_key: "cb8a0076a6acc9afe97b08cf7b41bd4b"
server_key_iv: "79727c52a7f005cac96fa595ea3a7992"
server_key_version: "encryptionkey@0"
I20260809 06:57:42.590502 1291 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:57:42.593971 1308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:42.595296 1291 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:57:42.595492 1291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "781f06b97f0545229af8455adb3802f3"
format_stamp: "Formatted at 2026-08-09 06:57:42 on dist-test-slave-0b58"
server_key: "cb8a0076a6acc9afe97b08cf7b41bd4b"
server_key_iv: "79727c52a7f005cac96fa595ea3a7992"
server_key_version: "encryptionkey@0"
I20260809 06:57:42.595705 1291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:42.627723 1291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:42.632164 1291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:42.632524 1291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:42.652328 1291 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45177
I20260809 06:57:42.652393 1361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45177 every 8 connection(s)
I20260809 06:57:42.653870 1291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:42.657829 1362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:42.657866 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 1291
I20260809 06:57:42.658079 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:42.658607 11061 external_mini_cluster.cc:1428] Setting key e1a02a5c8c86e385c35122e5516b9761
I20260809 06:57:42.673730 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:42.660599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:37975 (local address 127.0.0.1:45177)
0809 06:57:42.661496 (+ 897us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:42.661517 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:42.661572 (+ 55us) server_negotiation.cc:407] Connection header received
0809 06:57:42.663324 (+ 1752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:42.663352 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:42.663914 (+ 562us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:42.664386 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:42.664940 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:42.667010 (+ 2070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:42.668382 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:42.669463 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:42.669650 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:42.670889 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:42.670900 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:42.670919 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:42.671662 (+ 743us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:42.671762 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:42.671791 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:42.671951 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:42.672194 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 06:57:42.672414 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":377,"threads_started":1}
I20260809 06:57:42.673966 1362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3: Bootstrap starting.
I20260809 06:57:42.677268 1362 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:42.677793 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:42.678665 1362 log.cc:824] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:42.682226 1362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3: No bootstrap required, opened a new log
I20260809 06:57:42.690088 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:42.683068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:35591 (local address 127.0.0.1:45177)
0809 06:57:42.683245 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:42.683250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:42.683615 (+ 365us) server_negotiation.cc:407] Connection header received
0809 06:57:42.683779 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:42.683784 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:42.683882 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:42.683995 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:42.684662 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:42.685863 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:42.687229 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:42.687977 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:42.688111 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:42.689296 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:42.689302 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:42.689307 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:42.689332 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:42.689380 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:42.689401 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:42.689536 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:42.689681 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 06:57:42.689736 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:57:42.692510 1362 raft_consensus.cc:348] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "781f06b97f0545229af8455adb3802f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45177 } }
I20260809 06:57:42.692881 1362 raft_consensus.cc:374] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:42.693001 1362 raft_consensus.cc:729] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 781f06b97f0545229af8455adb3802f3, State: Initialized, Role: FOLLOWER
I20260809 06:57:42.693562 1362 consensus_queue.cc:260] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "781f06b97f0545229af8455adb3802f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45177 } }
I20260809 06:57:42.693804 1362 raft_consensus.cc:388] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:42.693958 1362 raft_consensus.cc:482] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:42.694150 1362 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:42.696419 1362 raft_consensus.cc:504] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "781f06b97f0545229af8455adb3802f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45177 } }
I20260809 06:57:42.696966 1362 leader_election.cc:302] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 781f06b97f0545229af8455adb3802f3; no voters:
I20260809 06:57:42.697665 1362 leader_election.cc:288] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:42.697801 1372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:42.698761 1372 raft_consensus.cc:686] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [term 1 LEADER]: Becoming Leader. State: Replica: 781f06b97f0545229af8455adb3802f3, State: Running, Role: LEADER
I20260809 06:57:42.699366 1372 consensus_queue.cc:237] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "781f06b97f0545229af8455adb3802f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45177 } }
I20260809 06:57:42.700186 1362 sys_catalog.cc:564] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:42.702399 1373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "781f06b97f0545229af8455adb3802f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "781f06b97f0545229af8455adb3802f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45177 } } }
I20260809 06:57:42.702850 1373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:42.704366 1377 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:42.704545 1374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 781f06b97f0545229af8455adb3802f3. Latest consensus state: current_term: 1 leader_uuid: "781f06b97f0545229af8455adb3802f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "781f06b97f0545229af8455adb3802f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45177 } } }
I20260809 06:57:42.704921 1374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:42.710009 1377 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:42.722306 1377 catalog_manager.cc:1347] Generated new cluster ID: b428d48de3cc440b885bb469dbeb4be0
I20260809 06:57:42.722436 1377 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:42.732111 1377 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:42.733573 1377 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:42.744967 1377 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 781f06b97f0545229af8455adb3802f3: Generated new TSK 0
I20260809 06:57:42.745855 1377 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:42.752732 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1291
W20260809 06:57:42.753849 1357 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.101:37975
W20260809 06:57:42.754623 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1291: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:57:42.754779 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 1291
W20260809 06:57:42.775483 1276 connection.cc:535] client connection to 127.0.0.1:45177 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45177): Connection reset by peer (error 104)
2026-08-09T06:57:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2061 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:42 dist-test-slave-0b58 krb5kdc[1397](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:42 dist-test-slave-0b58 krb5kdc[1397](info): set up 2 sockets
Aug 09 06:57:42 dist-test-slave-0b58 krb5kdc[1397](info): commencing operation
krb5kdc: starting...
W20260809 06:57:43.899305 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:44 dist-test-slave-0b58 krb5kdc[1397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258664, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:57:44.241765 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33981
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:44.589550 1410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:44.589917 1410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:44.590080 1410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:44.597528 1410 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:44.597675 1410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:44.597784 1410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:44.597899 1410 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:44.597985 1410 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:44.608048 1410 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33981
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:44.609428 1410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:44.610708 1410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:44.622751 1415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:44.622669 1418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:44.622717 1416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:44.623850 1410 server_base.cc:1034] running on GCE node
I20260809 06:57:44.624696 1410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:44.626092 1410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:44.627321 1410 hybrid_clock.cc:648] HybridClock initialized: now 1786258664627283 us; error 26 us; skew 500 ppm
I20260809 06:57:44.627683 1410 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:44 dist-test-slave-0b58 krb5kdc[1397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258664, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:44.634473 1410 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:57:44.636067 1410 webserver.cc:460] Webserver started at http://127.0.0.1:46213/ using document root <none> and password file <none>
I20260809 06:57:44.636861 1410 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:44.637014 1410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:44.637341 1410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:44.640412 1410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "4dc8af48e18641669f13ac9eabffd8bb"
format_stamp: "Formatted at 2026-08-09 06:57:44 on dist-test-slave-0b58"
server_key: "439e5b918ab7ed935eb86063391f00c9"
server_key_iv: "969b28d4cf4af8479e9bec16b93b8d78"
server_key_version: "encryptionkey@0"
I20260809 06:57:44.641196 1410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "4dc8af48e18641669f13ac9eabffd8bb"
format_stamp: "Formatted at 2026-08-09 06:57:44 on dist-test-slave-0b58"
server_key: "439e5b918ab7ed935eb86063391f00c9"
server_key_iv: "969b28d4cf4af8479e9bec16b93b8d78"
server_key_version: "encryptionkey@0"
I20260809 06:57:44.646584 1410 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:57:44.650044 1425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:44.651513 1410 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:57:44.651700 1410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "4dc8af48e18641669f13ac9eabffd8bb"
format_stamp: "Formatted at 2026-08-09 06:57:44 on dist-test-slave-0b58"
server_key: "439e5b918ab7ed935eb86063391f00c9"
server_key_iv: "969b28d4cf4af8479e9bec16b93b8d78"
server_key_version: "encryptionkey@0"
I20260809 06:57:44.651908 1410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:44.657819 1410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:44.662146 1410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:44.662446 1410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:44.681185 1410 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33981
I20260809 06:57:44.681236 1479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33981 every 8 connection(s)
I20260809 06:57:44.682610 1410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:44.684939 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 1410
I20260809 06:57:44.685115 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:44.685575 11061 external_mini_cluster.cc:1428] Setting key 69b471bba09dc7b974924a4913352ae3
I20260809 06:57:44.686451 1480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:44.693349 1483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:44.687416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:47349 (local address 127.0.0.1:33981)
0809 06:57:44.688190 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:44.688202 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:44.688242 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:57:44.689862 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:44.689881 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:44.690211 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:44.690603 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:44.691670 (+ 1067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:44.691676 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:44.691692 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:44.691709 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:44.691780 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:44.691802 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:44.692050 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:44.692191 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 06:57:44.692428 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":333,"threads_started":1}
I20260809 06:57:44.696924 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:44.699216 1480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb: Bootstrap starting.
I20260809 06:57:44.703090 1480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:44.703814 1483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:44.701155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:58705 (local address 127.0.0.1:33981)
0809 06:57:44.701372 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:44.701382 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:44.701839 (+ 457us) server_negotiation.cc:407] Connection header received
0809 06:57:44.702006 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:44.702010 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:44.702056 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:44.702140 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:44.703125 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:44.703128 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:44.703132 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:44.703145 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:44.703214 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:44.703238 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:44.703337 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:44.703474 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 06:57:44.703524 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:57:44.704425 1480 log.cc:824] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:44.707137 1480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb: No bootstrap required, opened a new log
I20260809 06:57:44.714313 1480 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc8af48e18641669f13ac9eabffd8bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33981 } }
I20260809 06:57:44.714709 1480 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:44.714823 1480 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dc8af48e18641669f13ac9eabffd8bb, State: Initialized, Role: FOLLOWER
I20260809 06:57:44.715402 1480 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc8af48e18641669f13ac9eabffd8bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33981 } }
I20260809 06:57:44.715628 1480 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:44.715799 1480 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:44.715970 1480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:44.718191 1480 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc8af48e18641669f13ac9eabffd8bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33981 } }
I20260809 06:57:44.718699 1480 leader_election.cc:302] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4dc8af48e18641669f13ac9eabffd8bb; no voters:
I20260809 06:57:44.719400 1480 leader_election.cc:288] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:44.719508 1490 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:44.720180 1490 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [term 1 LEADER]: Becoming Leader. State: Replica: 4dc8af48e18641669f13ac9eabffd8bb, State: Running, Role: LEADER
I20260809 06:57:44.720754 1490 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc8af48e18641669f13ac9eabffd8bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33981 } }
I20260809 06:57:44.721709 1480 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:44.723819 1491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4dc8af48e18641669f13ac9eabffd8bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc8af48e18641669f13ac9eabffd8bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33981 } } }
I20260809 06:57:44.724328 1491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:44.723838 1492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4dc8af48e18641669f13ac9eabffd8bb. Latest consensus state: current_term: 1 leader_uuid: "4dc8af48e18641669f13ac9eabffd8bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc8af48e18641669f13ac9eabffd8bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33981 } } }
I20260809 06:57:44.725452 1492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:44.727357 1497 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:44.732996 1497 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:44.742624 1497 catalog_manager.cc:1347] Generated new cluster ID: 0fb568bc6b8a40519a8ec812c4d90059
I20260809 06:57:44.742758 1497 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:44.757866 1497 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:44.758275 1497 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:44.766368 1497 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4dc8af48e18641669f13ac9eabffd8bb: Generated new TSK 0
I20260809 06:57:44.767120 1497 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:44.777580 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1410
W20260809 06:57:44.779152 1475 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.101:47349
W20260809 06:57:44.779829 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1410: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:57:44.779981 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 1410
2026-08-09T06:57:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2021 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:44 dist-test-slave-0b58 krb5kdc[1511](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:44 dist-test-slave-0b58 krb5kdc[1511](info): set up 2 sockets
Aug 09 06:57:44 dist-test-slave-0b58 krb5kdc[1511](info): commencing operation
krb5kdc: starting...
W20260809 06:57:45.919821 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.003s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:46 dist-test-slave-0b58 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:57:46.254897 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:40753
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:34125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:40753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:46.602151 1525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:46.602521 1525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:46.602701 1525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:46.610155 1525 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:46.610321 1525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:46.610438 1525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:46.610550 1525 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:46.610630 1525 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:46.620648 1525 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:34125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:40753
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:40753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:46.622047 1525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:46.623406 1525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:46.635969 1533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:46.636140 1530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:46.636126 1531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:46.636921 1525 server_base.cc:1034] running on GCE node
I20260809 06:57:46.637713 1525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:46.639163 1525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:46.640372 1525 hybrid_clock.cc:648] HybridClock initialized: now 1786258666640309 us; error 36 us; skew 500 ppm
I20260809 06:57:46.640730 1525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:46 dist-test-slave-0b58 krb5kdc[1511](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258666, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:46.643877 1525 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:57:46.645558 1525 webserver.cc:460] Webserver started at http://127.10.205.126:45523/ using document root <none> and password file <none>
I20260809 06:57:46.646373 1525 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:46.646531 1525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:46.646852 1525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:46.649986 1525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "d17df20ec9404d4bb1b2d94d2212c22b"
format_stamp: "Formatted at 2026-08-09 06:57:46 on dist-test-slave-0b58"
server_key: "751932c0757f37aa423b8f3f50a275d9"
server_key_iv: "2d793259e22213d8863833a0c4baa824"
server_key_version: "encryptionkey@0"
I20260809 06:57:46.650764 1525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "d17df20ec9404d4bb1b2d94d2212c22b"
format_stamp: "Formatted at 2026-08-09 06:57:46 on dist-test-slave-0b58"
server_key: "751932c0757f37aa423b8f3f50a275d9"
server_key_iv: "2d793259e22213d8863833a0c4baa824"
server_key_version: "encryptionkey@0"
I20260809 06:57:46.656010 1525 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 06:57:46.659544 1541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:46.660897 1525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 06:57:46.661088 1525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "d17df20ec9404d4bb1b2d94d2212c22b"
format_stamp: "Formatted at 2026-08-09 06:57:46 on dist-test-slave-0b58"
server_key: "751932c0757f37aa423b8f3f50a275d9"
server_key_iv: "2d793259e22213d8863833a0c4baa824"
server_key_version: "encryptionkey@0"
I20260809 06:57:46.661299 1525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:46.682075 1525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:46.686098 1525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:46.686456 1525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:46.705436 1525 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:40753
I20260809 06:57:46.705444 1595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:40753 every 8 connection(s)
I20260809 06:57:46.706864 1525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:46.707408 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 1525
I20260809 06:57:46.707607 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:46.708238 11061 external_mini_cluster.cc:1428] Setting key 5f3318ea5f551d806811a5157a885ff3
I20260809 06:57:46.711222 1596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:46.721573 1596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b: Bootstrap starting.
Aug 09 06:57:46 dist-test-slave-0b58 krb5kdc[1511](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:46.725121 1596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:46.726293 1596 log.cc:824] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:46.729529 1596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b: No bootstrap required, opened a new log
I20260809 06:57:46.731184 1599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:46.710047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35775 (local address 127.10.205.126:40753)
0809 06:57:46.710883 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:46.710894 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:46.710936 (+ 42us) server_negotiation.cc:407] Connection header received
0809 06:57:46.712751 (+ 1815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:46.712774 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:46.713171 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:46.713570 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:46.715170 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:46.716602 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:46.717916 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:46.718599 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:46.718841 (+ 242us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:46.723252 (+ 4411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:46.723260 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:46.723273 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:46.723319 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:46.726881 (+ 3562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:46.727767 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:46.727773 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:46.727779 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:46.727973 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:46.728531 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:46.728534 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:46.728537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:46.729017 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:46.729272 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:46.729829 (+ 557us) server_negotiation.cc:299] Negotiation successful
0809 06:57:46.730182 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":395,"threads_started":1}
I20260809 06:57:46.735608 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:46.739595 1596 raft_consensus.cc:348] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d17df20ec9404d4bb1b2d94d2212c22b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40753 } }
I20260809 06:57:46.740132 1596 raft_consensus.cc:374] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:46.740226 1596 raft_consensus.cc:729] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17df20ec9404d4bb1b2d94d2212c22b, State: Initialized, Role: FOLLOWER
I20260809 06:57:46.740984 1596 consensus_queue.cc:260] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d17df20ec9404d4bb1b2d94d2212c22b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40753 } }
I20260809 06:57:46.741307 1596 raft_consensus.cc:388] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:46.741460 1596 raft_consensus.cc:482] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:46.741670 1596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:46.744448 1596 raft_consensus.cc:504] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d17df20ec9404d4bb1b2d94d2212c22b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40753 } }
I20260809 06:57:46.745090 1596 leader_election.cc:302] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d17df20ec9404d4bb1b2d94d2212c22b; no voters:
I20260809 06:57:46.745723 1596 leader_election.cc:288] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:46.745863 1607 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:46.746541 1607 raft_consensus.cc:686] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [term 1 LEADER]: Becoming Leader. State: Replica: d17df20ec9404d4bb1b2d94d2212c22b, State: Running, Role: LEADER
I20260809 06:57:46.747148 1607 consensus_queue.cc:237] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d17df20ec9404d4bb1b2d94d2212c22b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40753 } }
I20260809 06:57:46.750437 1596 sys_catalog.cc:564] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:46.750187 1609 sys_catalog.cc:455] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d17df20ec9404d4bb1b2d94d2212c22b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d17df20ec9404d4bb1b2d94d2212c22b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40753 } } }
I20260809 06:57:46.750630 1609 sys_catalog.cc:458] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:46.751583 1608 sys_catalog.cc:455] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d17df20ec9404d4bb1b2d94d2212c22b. Latest consensus state: current_term: 1 leader_uuid: "d17df20ec9404d4bb1b2d94d2212c22b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d17df20ec9404d4bb1b2d94d2212c22b" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 40753 } } }
I20260809 06:57:46.751982 1608 sys_catalog.cc:458] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:46.755137 1611 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:46.760895 1611 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:46.762449 1599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:46.741227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49177 (local address 127.10.205.126:40753)
0809 06:57:46.741436 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:46.741444 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:46.741888 (+ 444us) server_negotiation.cc:407] Connection header received
0809 06:57:46.742054 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:46.742061 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:46.742147 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:46.742257 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:46.743691 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:46.744855 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:46.746780 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:46.747465 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:46.747575 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:46.751426 (+ 3851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:46.751432 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:46.751437 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:46.751485 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:46.756402 (+ 4917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:46.757694 (+ 1292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:46.757715 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:46.757722 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:46.758021 (+ 299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:46.758797 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:46.758805 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:46.758810 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:46.759361 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:46.759785 (+ 424us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:46.761630 (+ 1845us) server_negotiation.cc:299] Negotiation successful
0809 06:57:46.761905 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 06:57:46.772153 1611 catalog_manager.cc:1347] Generated new cluster ID: 7c0f3300546d479180ab63d309e8cd6a
I20260809 06:57:46.772325 1611 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:46.782176 1611 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:46.783643 1611 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:46.794095 1611 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d17df20ec9404d4bb1b2d94d2212c22b: Generated new TSK 0
I20260809 06:57:46.794952 1611 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:46.801103 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1525
I20260809 06:57:46.802389 1591 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:46.891381 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 1525
W20260809 06:57:46.912050 1509 connection.cc:535] client connection to 127.10.205.126:40753 recv error: Network error: failed to read from TLS socket (remote: 127.10.205.126:40753): Connection reset by peer (error 104)
2026-08-09T06:57:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2114 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:47 dist-test-slave-0b58 krb5kdc[1630](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:47 dist-test-slave-0b58 krb5kdc[1630](info): set up 2 sockets
Aug 09 06:57:47 dist-test-slave-0b58 krb5kdc[1630](info): commencing operation
krb5kdc: starting...
W20260809 06:57:48.027217 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.003s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:48 dist-test-slave-0b58 krb5kdc[1630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:57:48.379072 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:39833
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:36715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:39833
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:48.737761 1643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:48.738157 1643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:48.738341 1643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:48.745980 1643 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:48.746168 1643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:48.746290 1643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:48.746405 1643 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:48.746496 1643 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:48.756810 1643 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:36715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:39833
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:39833
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:48.758306 1643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:48.759680 1643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:48.772150 1648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:48.772274 1652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:48.772219 1649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:48.773885 1643 server_base.cc:1034] running on GCE node
I20260809 06:57:48.774736 1643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:48.776397 1643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:48.777607 1643 hybrid_clock.cc:648] HybridClock initialized: now 1786258668777555 us; error 57 us; skew 500 ppm
I20260809 06:57:48.777974 1643 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:48 dist-test-slave-0b58 krb5kdc[1630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258668, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:48.781183 1643 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:57:48.782820 1643 webserver.cc:460] Webserver started at http://127.10.205.126:34549/ using document root <none> and password file <none>
I20260809 06:57:48.783571 1643 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:48.783730 1643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:48.784056 1643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:48.787309 1643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "b3b6db2cd5c243d59adf5452e16be9cc"
format_stamp: "Formatted at 2026-08-09 06:57:48 on dist-test-slave-0b58"
server_key: "64d1229fe5734f12ef840034b985940c"
server_key_iv: "af29a70bbbf67925a1b03cdbfa701059"
server_key_version: "encryptionkey@0"
I20260809 06:57:48.788128 1643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "b3b6db2cd5c243d59adf5452e16be9cc"
format_stamp: "Formatted at 2026-08-09 06:57:48 on dist-test-slave-0b58"
server_key: "64d1229fe5734f12ef840034b985940c"
server_key_iv: "af29a70bbbf67925a1b03cdbfa701059"
server_key_version: "encryptionkey@0"
I20260809 06:57:48.793578 1643 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260809 06:57:48.797322 1660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:48.798767 1643 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 06:57:48.798978 1643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "b3b6db2cd5c243d59adf5452e16be9cc"
format_stamp: "Formatted at 2026-08-09 06:57:48 on dist-test-slave-0b58"
server_key: "64d1229fe5734f12ef840034b985940c"
server_key_iv: "af29a70bbbf67925a1b03cdbfa701059"
server_key_version: "encryptionkey@0"
I20260809 06:57:48.799211 1643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:48.813613 1643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:48.817945 1643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:48.818265 1643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:48.837527 1643 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:39833
I20260809 06:57:48.837549 1711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:39833 every 8 connection(s)
I20260809 06:57:48.839051 1643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:48.843112 1712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:48.843535 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 1643
I20260809 06:57:48.843750 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:48.844352 11061 external_mini_cluster.cc:1428] Setting key 4efb08b5cf596538c5ae2a1e93afbe26
I20260809 06:57:48.859628 1715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:48.846258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45937 (local address 127.10.205.126:39833)
0809 06:57:48.847153 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:48.847169 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:48.847228 (+ 59us) server_negotiation.cc:407] Connection header received
0809 06:57:48.849064 (+ 1836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:48.849098 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:48.849649 (+ 551us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:48.850139 (+ 490us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:48.850707 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:48.852775 (+ 2068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:48.854115 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:48.855216 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:48.855405 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:48.856773 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:48.856784 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:48.856804 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:48.857584 (+ 780us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:48.857695 (+ 111us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:48.857739 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:48.857897 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:48.858097 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 06:57:48.858279 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":381,"threads_started":1}
I20260809 06:57:48.859864 1712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc: Bootstrap starting.
I20260809 06:57:48.863368 1712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:48.863679 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:48.864766 1712 log.cc:824] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:48.868458 1712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc: No bootstrap required, opened a new log
I20260809 06:57:48.876056 1715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:48.868986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43805 (local address 127.10.205.126:39833)
0809 06:57:48.869204 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:48.869211 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:48.869754 (+ 543us) server_negotiation.cc:407] Connection header received
0809 06:57:48.869893 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:48.869899 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:48.869977 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:48.870089 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:48.870579 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:48.871791 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:48.873177 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:48.873934 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:48.874087 (+ 153us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:48.875216 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:48.875224 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:48.875229 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:48.875253 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:48.875328 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:48.875349 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:48.875474 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:48.875628 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 06:57:48.875698 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:57:48.878549 1712 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b6db2cd5c243d59adf5452e16be9cc" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39833 } }
I20260809 06:57:48.878966 1712 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:48.879096 1712 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b6db2cd5c243d59adf5452e16be9cc, State: Initialized, Role: FOLLOWER
I20260809 06:57:48.879792 1712 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b6db2cd5c243d59adf5452e16be9cc" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39833 } }
I20260809 06:57:48.880044 1712 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:48.880224 1712 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:48.880481 1712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:48.882869 1712 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b6db2cd5c243d59adf5452e16be9cc" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39833 } }
I20260809 06:57:48.883419 1712 leader_election.cc:302] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3b6db2cd5c243d59adf5452e16be9cc; no voters:
I20260809 06:57:48.884023 1712 leader_election.cc:288] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:48.884191 1722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:48.885656 1722 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [term 1 LEADER]: Becoming Leader. State: Replica: b3b6db2cd5c243d59adf5452e16be9cc, State: Running, Role: LEADER
I20260809 06:57:48.886204 1722 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b6db2cd5c243d59adf5452e16be9cc" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39833 } }
I20260809 06:57:48.886528 1712 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:48.889225 1723 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3b6db2cd5c243d59adf5452e16be9cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b6db2cd5c243d59adf5452e16be9cc" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39833 } } }
I20260809 06:57:48.889250 1724 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3b6db2cd5c243d59adf5452e16be9cc. Latest consensus state: current_term: 1 leader_uuid: "b3b6db2cd5c243d59adf5452e16be9cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b6db2cd5c243d59adf5452e16be9cc" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 39833 } } }
I20260809 06:57:48.889690 1723 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:48.889690 1724 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc [sys.catalog]: This master's current role is: LEADER
W20260809 06:57:48.903474 1740 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:57:48.903679 1740 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:57:48.904031 1730 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:48.906077 1730 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:48.914776 1730 catalog_manager.cc:1347] Generated new cluster ID: b3de8cdbd1d84f2c8ae71ce29e600fbf
I20260809 06:57:48.914906 1730 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:48.927554 1730 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:48.929418 1730 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:48.942421 1730 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3b6db2cd5c243d59adf5452e16be9cc: Generated new TSK 0
I20260809 06:57:48.943569 1730 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:48.955578 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1643
W20260809 06:57:48.956910 1707 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:45937
W20260809 06:57:48.957737 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1643: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:57:48.957906 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 1643
W20260809 06:57:48.979759 1628 connection.cc:535] client connection to 127.10.205.126:39833 recv error: Network error: failed to read from TLS socket (remote: 127.10.205.126:39833): Connection reset by peer (error 104)
2026-08-09T06:57:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2067 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:49 dist-test-slave-0b58 krb5kdc[1745](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:49 dist-test-slave-0b58 krb5kdc[1745](info): set up 2 sockets
Aug 09 06:57:49 dist-test-slave-0b58 krb5kdc[1745](info): commencing operation
krb5kdc: starting...
W20260809 06:57:50.131186 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.001s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:50 dist-test-slave-0b58 krb5kdc[1745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258670, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:57:50.467662 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:35881
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:39037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:35881
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:50.817478 1759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:50.817818 1759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:50.817916 1759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:50.825367 1759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:50.825490 1759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:50.825538 1759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:50.825603 1759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:50.825647 1759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:50.835634 1759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:39037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:35881
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:35881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:50.837103 1759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:50.838462 1759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:50.850554 1767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:50.850647 1765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:50.850616 1764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:50.851495 1759 server_base.cc:1034] running on GCE node
I20260809 06:57:50.852416 1759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:50.853881 1759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:50.855087 1759 hybrid_clock.cc:648] HybridClock initialized: now 1786258670855047 us; error 40 us; skew 500 ppm
I20260809 06:57:50.855470 1759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:50 dist-test-slave-0b58 krb5kdc[1745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258670, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:50.863322 1759 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:57:50.864984 1759 webserver.cc:460] Webserver started at http://127.10.205.126:34367/ using document root <none> and password file <none>
I20260809 06:57:50.865646 1759 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:50.865756 1759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:50.866016 1759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:50.869143 1759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "46266bd35f154491b01435b98f96e942"
format_stamp: "Formatted at 2026-08-09 06:57:50 on dist-test-slave-0b58"
server_key: "1e4500dc2982130a7dab9baded6ffe5d"
server_key_iv: "40cf53b329364d9e4ebd1bd0758df7e3"
server_key_version: "encryptionkey@0"
I20260809 06:57:50.869879 1759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "46266bd35f154491b01435b98f96e942"
format_stamp: "Formatted at 2026-08-09 06:57:50 on dist-test-slave-0b58"
server_key: "1e4500dc2982130a7dab9baded6ffe5d"
server_key_iv: "40cf53b329364d9e4ebd1bd0758df7e3"
server_key_version: "encryptionkey@0"
I20260809 06:57:50.875046 1759 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:57:50.878539 1774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:50.879820 1759 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260809 06:57:50.880000 1759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "46266bd35f154491b01435b98f96e942"
format_stamp: "Formatted at 2026-08-09 06:57:50 on dist-test-slave-0b58"
server_key: "1e4500dc2982130a7dab9baded6ffe5d"
server_key_iv: "40cf53b329364d9e4ebd1bd0758df7e3"
server_key_version: "encryptionkey@0"
I20260809 06:57:50.880213 1759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:50.886113 1759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:50.890266 1759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:50.890589 1759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:50.909965 1828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:35881 every 8 connection(s)
I20260809 06:57:50.909965 1759 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:35881
I20260809 06:57:50.911412 1759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:50.915225 1829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:50.921052 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 1759
I20260809 06:57:50.921258 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:50.921851 11061 external_mini_cluster.cc:1428] Setting key 346f2af603a839205781b187c745d477
I20260809 06:57:50.926826 1829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942: Bootstrap starting.
I20260809 06:57:50.930466 1832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:50.923761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32921 (local address 127.10.205.126:35881)
0809 06:57:50.924926 (+ 1165us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:50.924939 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:50.924985 (+ 46us) server_negotiation.cc:407] Connection header received
0809 06:57:50.926699 (+ 1714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:50.926723 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:50.927201 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:50.927532 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:50.928888 (+ 1356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:50.928895 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:50.928907 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:50.928922 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:50.928986 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:50.929006 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:50.929186 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:50.929339 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 06:57:50.929549 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":491,"threads_started":1}
I20260809 06:57:50.930756 1829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:50.931936 1829 log.cc:824] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:50.934476 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:50.935217 1829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942: No bootstrap required, opened a new log
I20260809 06:57:50.942445 1832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:50.939882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48589 (local address 127.10.205.126:35881)
0809 06:57:50.940092 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:50.940098 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:50.940411 (+ 313us) server_negotiation.cc:407] Connection header received
0809 06:57:50.940591 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:50.940595 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:50.940644 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:50.940741 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:50.941753 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:50.941757 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:50.941761 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:50.941775 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:50.941820 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:50.941836 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:50.941940 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:50.942066 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 06:57:50.942116 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 06:57:50.945367 1829 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46266bd35f154491b01435b98f96e942" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 35881 } }
I20260809 06:57:50.945777 1829 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:50.945894 1829 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46266bd35f154491b01435b98f96e942, State: Initialized, Role: FOLLOWER
I20260809 06:57:50.946484 1829 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46266bd35f154491b01435b98f96e942" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 35881 } }
I20260809 06:57:50.946750 1829 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:50.946904 1829 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:50.947103 1829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:50.949550 1829 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46266bd35f154491b01435b98f96e942" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 35881 } }
I20260809 06:57:50.950079 1829 leader_election.cc:302] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46266bd35f154491b01435b98f96e942; no voters:
I20260809 06:57:50.950711 1829 leader_election.cc:288] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:50.950870 1839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:50.951570 1839 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [term 1 LEADER]: Becoming Leader. State: Replica: 46266bd35f154491b01435b98f96e942, State: Running, Role: LEADER
I20260809 06:57:50.952167 1839 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46266bd35f154491b01435b98f96e942" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 35881 } }
I20260809 06:57:50.953018 1829 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:50.955480 1840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46266bd35f154491b01435b98f96e942" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46266bd35f154491b01435b98f96e942" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 35881 } } }
I20260809 06:57:50.955538 1841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46266bd35f154491b01435b98f96e942. Latest consensus state: current_term: 1 leader_uuid: "46266bd35f154491b01435b98f96e942" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46266bd35f154491b01435b98f96e942" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 35881 } } }
I20260809 06:57:50.955969 1840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:50.955969 1841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:50.958299 1845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:50.963747 1845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:50.974828 1845 catalog_manager.cc:1347] Generated new cluster ID: c8b4db67432148dfb6ed1df9bdfa725e
I20260809 06:57:50.974952 1845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:51.008134 1845 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:51.008611 1845 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:51.021637 1845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46266bd35f154491b01435b98f96e942: Generated new TSK 0
I20260809 06:57:51.022603 1845 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:51.038057 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1759
W20260809 06:57:51.039662 1824 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:32921
W20260809 06:57:51.040548 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1759: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:57:51.040701 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 1759
2026-08-09T06:57:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2083 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:51 dist-test-slave-0b58 krb5kdc[1860](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:51 dist-test-slave-0b58 krb5kdc[1860](info): set up 2 sockets
Aug 09 06:57:51 dist-test-slave-0b58 krb5kdc[1860](info): commencing operation
krb5kdc: starting...
W20260809 06:57:52.215431 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:52 dist-test-slave-0b58 krb5kdc[1860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:57:52.556047 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:42487
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:42487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:52.908674 1873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:52.908963 1873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:52.909171 1873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:52.916543 1873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:52.916662 1873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:52.916762 1873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:52.916872 1873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:52.916960 1873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:52.927028 1873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:42487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:42487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:52.928493 1873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:52.929905 1873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:52.942155 1878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:52.942190 1881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:52.942107 1879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:52.943117 1873 server_base.cc:1034] running on GCE node
I20260809 06:57:52.943850 1873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:52.945348 1873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:52.946576 1873 hybrid_clock.cc:648] HybridClock initialized: now 1786258672946542 us; error 51 us; skew 500 ppm
I20260809 06:57:52.946938 1873 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:52 dist-test-slave-0b58 krb5kdc[1860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258672, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:52.950055 1873 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:57:52.951601 1873 webserver.cc:460] Webserver started at http://127.10.205.126:35363/ using document root <none> and password file <none>
I20260809 06:57:52.952456 1873 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:52.952612 1873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:52.952922 1873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:52.955943 1873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "ef9a1a23f6ce47ac82fafdf8777e2f48"
format_stamp: "Formatted at 2026-08-09 06:57:52 on dist-test-slave-0b58"
server_key: "ec416551443948b556f1118870554cf9"
server_key_iv: "b2ff7ab935a7a81477789268c44e85a8"
server_key_version: "encryptionkey@0"
I20260809 06:57:52.956758 1873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "ef9a1a23f6ce47ac82fafdf8777e2f48"
format_stamp: "Formatted at 2026-08-09 06:57:52 on dist-test-slave-0b58"
server_key: "ec416551443948b556f1118870554cf9"
server_key_iv: "b2ff7ab935a7a81477789268c44e85a8"
server_key_version: "encryptionkey@0"
I20260809 06:57:52.961882 1873 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:57:52.965306 1889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:52.966552 1873 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:57:52.966743 1873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "ef9a1a23f6ce47ac82fafdf8777e2f48"
format_stamp: "Formatted at 2026-08-09 06:57:52 on dist-test-slave-0b58"
server_key: "ec416551443948b556f1118870554cf9"
server_key_iv: "b2ff7ab935a7a81477789268c44e85a8"
server_key_version: "encryptionkey@0"
I20260809 06:57:52.966950 1873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:52.988221 1873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:52.992614 1873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:52.992926 1873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:53.012831 1873 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:42487
I20260809 06:57:53.012851 1943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:42487 every 8 connection(s)
I20260809 06:57:53.014266 1873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:53.017998 1944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:53.019917 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 1873
I20260809 06:57:53.020112 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:53.020752 11061 external_mini_cluster.cc:1428] Setting key c66b4f7b6e13629f7cdb3ba25a7f66d3
I20260809 06:57:53.032899 1944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48: Bootstrap starting.
Aug 09 06:57:53 dist-test-slave-0b58 krb5kdc[1860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:53.036753 1944 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:53.037955 1944 log.cc:824] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:53.040952 1944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48: No bootstrap required, opened a new log
I20260809 06:57:53.044543 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:53.022595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60455 (local address 127.10.205.126:42487)
0809 06:57:53.023446 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:53.023459 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:53.023503 (+ 44us) server_negotiation.cc:407] Connection header received
0809 06:57:53.025236 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:53.025259 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:53.025663 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:53.025989 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:53.027882 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:53.029227 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:53.031111 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:53.031732 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:53.031879 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:53.036896 (+ 5017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:53.036907 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:53.036926 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:53.036981 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:53.040303 (+ 3322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:53.041000 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:53.041011 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:53.041025 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:53.041255 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:53.041657 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:53.041663 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:53.041666 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:53.042210 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:53.042559 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:53.043026 (+ 467us) server_negotiation.cc:299] Negotiation successful
0809 06:57:53.043444 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":394,"threads_started":1}
I20260809 06:57:53.048292 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:53.049378 1944 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9a1a23f6ce47ac82fafdf8777e2f48" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42487 } }
I20260809 06:57:53.049759 1944 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:53.049867 1944 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9a1a23f6ce47ac82fafdf8777e2f48, State: Initialized, Role: FOLLOWER
I20260809 06:57:53.050407 1944 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9a1a23f6ce47ac82fafdf8777e2f48" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42487 } }
I20260809 06:57:53.050681 1944 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:53.050829 1944 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:53.051008 1944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:53.053726 1944 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9a1a23f6ce47ac82fafdf8777e2f48" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42487 } }
I20260809 06:57:53.054378 1944 leader_election.cc:302] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef9a1a23f6ce47ac82fafdf8777e2f48; no voters:
I20260809 06:57:53.054997 1944 leader_election.cc:288] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:53.055150 1954 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:53.057718 1944 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:53.062429 1954 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [term 1 LEADER]: Becoming Leader. State: Replica: ef9a1a23f6ce47ac82fafdf8777e2f48, State: Running, Role: LEADER
I20260809 06:57:53.063200 1954 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9a1a23f6ce47ac82fafdf8777e2f48" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42487 } }
I20260809 06:57:53.066525 1955 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef9a1a23f6ce47ac82fafdf8777e2f48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9a1a23f6ce47ac82fafdf8777e2f48" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42487 } } }
I20260809 06:57:53.066606 1956 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef9a1a23f6ce47ac82fafdf8777e2f48. Latest consensus state: current_term: 1 leader_uuid: "ef9a1a23f6ce47ac82fafdf8777e2f48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9a1a23f6ce47ac82fafdf8777e2f48" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 42487 } } }
I20260809 06:57:53.066946 1955 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:53.066943 1956 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:53.072798 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:53.053059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50267 (local address 127.10.205.126:42487)
0809 06:57:53.053252 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:53.053258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:53.053793 (+ 535us) server_negotiation.cc:407] Connection header received
0809 06:57:53.053945 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:53.053950 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:53.054024 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:53.054138 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:53.056282 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:53.057736 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:53.060447 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:53.061456 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:53.061586 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:53.065095 (+ 3509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:53.065105 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:53.065109 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:53.065151 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:53.069407 (+ 4256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:53.070562 (+ 1155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:53.070566 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:53.070568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:53.070686 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:53.071170 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:53.071174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:53.071176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:53.071675 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:53.071849 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:53.072395 (+ 546us) server_negotiation.cc:299] Negotiation successful
0809 06:57:53.072555 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 06:57:53.077678 1970 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:57:53.077832 1970 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:57:53.077967 1969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:53.079634 1969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:53.088172 1969 catalog_manager.cc:1347] Generated new cluster ID: f3fd0334aff74dffab81455a3f02623c
I20260809 06:57:53.088377 1969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:53.119050 1969 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:53.121078 1969 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:53.132140 1969 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef9a1a23f6ce47ac82fafdf8777e2f48: Generated new TSK 0
I20260809 06:57:53.133210 1969 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:53.142796 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1873
I20260809 06:57:53.144083 1939 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:57:53.238787 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 1873
2026-08-09T06:57:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2196 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:53 dist-test-slave-0b58 krb5kdc[1977](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:53 dist-test-slave-0b58 krb5kdc[1977](info): set up 2 sockets
Aug 09 06:57:53 dist-test-slave-0b58 krb5kdc[1977](info): commencing operation
krb5kdc: starting...
W20260809 06:57:54.403601 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.002s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:54 dist-test-slave-0b58 krb5kdc[1977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258674, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:57:54.750893 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:41879
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:33161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:41879
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:55.098445 1990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:55.098843 1990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:55.099037 1990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:55.106361 1990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:55.106534 1990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:55.106647 1990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:55.106769 1990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:55.106858 1990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:55.116945 1990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:33161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:41879
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:41879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:55.118460 1990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:55.119940 1990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:55.132741 1995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:55.132661 1999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:55.132700 1996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:55.133509 1990 server_base.cc:1034] running on GCE node
I20260809 06:57:55.134348 1990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:55.135815 1990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:55.137040 1990 hybrid_clock.cc:648] HybridClock initialized: now 1786258675136987 us; error 48 us; skew 500 ppm
I20260809 06:57:55.137399 1990 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:55 dist-test-slave-0b58 krb5kdc[1977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258675, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:55.140621 1990 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:57:55.142187 1990 webserver.cc:460] Webserver started at http://127.10.205.126:40803/ using document root <none> and password file <none>
I20260809 06:57:55.142896 1990 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:55.143056 1990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:55.143378 1990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:55.146548 1990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "b199ab74f6a3441c88ba334f94fc624d"
format_stamp: "Formatted at 2026-08-09 06:57:55 on dist-test-slave-0b58"
server_key: "3c4e5112a07858f06b1ef34618031cbe"
server_key_iv: "a62a755447099683bd0efd5840c33688"
server_key_version: "encryptionkey@0"
I20260809 06:57:55.147354 1990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "b199ab74f6a3441c88ba334f94fc624d"
format_stamp: "Formatted at 2026-08-09 06:57:55 on dist-test-slave-0b58"
server_key: "3c4e5112a07858f06b1ef34618031cbe"
server_key_iv: "a62a755447099683bd0efd5840c33688"
server_key_version: "encryptionkey@0"
I20260809 06:57:55.152947 1990 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 06:57:55.156623 2007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:55.158130 1990 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:57:55.158361 1990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "b199ab74f6a3441c88ba334f94fc624d"
format_stamp: "Formatted at 2026-08-09 06:57:55 on dist-test-slave-0b58"
server_key: "3c4e5112a07858f06b1ef34618031cbe"
server_key_iv: "a62a755447099683bd0efd5840c33688"
server_key_version: "encryptionkey@0"
I20260809 06:57:55.158586 1990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:55.176517 1990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:55.181113 1990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:55.181456 1990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:55.200565 1990 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:41879
I20260809 06:57:55.200587 2061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:41879 every 8 connection(s)
I20260809 06:57:55.202018 1990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:55.205397 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 1990
I20260809 06:57:55.205579 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:55.206156 11061 external_mini_cluster.cc:1428] Setting key 16647b388a5272da4134d96c32293694
I20260809 06:57:55.206203 2062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:55.218883 2062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d: Bootstrap starting.
I20260809 06:57:55.219780 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:55.208063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54631 (local address 127.10.205.126:41879)
0809 06:57:55.208855 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:55.208869 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:55.208909 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:57:55.211027 (+ 2118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:55.211051 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:55.211440 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:55.211857 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:55.212488 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:55.213823 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:55.215196 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:55.215889 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:55.216099 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:55.217432 (+ 1333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:55.217440 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:55.217454 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:55.217995 (+ 541us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:55.218076 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:55.218101 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:55.218233 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:55.218472 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 06:57:55.218755 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":375,"threads_started":1}
I20260809 06:57:55.222136 2062 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:55.223428 2062 log.cc:824] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:55.223680 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:55.226408 2062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d: No bootstrap required, opened a new log
I20260809 06:57:55.235162 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:55.228223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40867 (local address 127.10.205.126:41879)
0809 06:57:55.228461 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:55.228467 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:55.228896 (+ 429us) server_negotiation.cc:407] Connection header received
0809 06:57:55.229037 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:55.229043 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:55.229125 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:55.229255 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:55.229771 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:55.230883 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:55.232232 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:55.232980 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:55.233125 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:55.234301 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:55.234307 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:55.234313 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:55.234347 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:55.234396 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:55.234424 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:55.234528 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:55.234716 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 06:57:55.234819 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 06:57:55.236060 2062 raft_consensus.cc:348] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b199ab74f6a3441c88ba334f94fc624d" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41879 } }
I20260809 06:57:55.236536 2062 raft_consensus.cc:374] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:55.236653 2062 raft_consensus.cc:729] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b199ab74f6a3441c88ba334f94fc624d, State: Initialized, Role: FOLLOWER
I20260809 06:57:55.237252 2062 consensus_queue.cc:260] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b199ab74f6a3441c88ba334f94fc624d" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41879 } }
I20260809 06:57:55.237519 2062 raft_consensus.cc:388] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:55.237668 2062 raft_consensus.cc:482] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:55.237857 2062 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:55.240134 2062 raft_consensus.cc:504] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b199ab74f6a3441c88ba334f94fc624d" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41879 } }
I20260809 06:57:55.240659 2062 leader_election.cc:302] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b199ab74f6a3441c88ba334f94fc624d; no voters:
I20260809 06:57:55.241361 2062 leader_election.cc:288] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:55.241482 2072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:55.242236 2072 raft_consensus.cc:686] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [term 1 LEADER]: Becoming Leader. State: Replica: b199ab74f6a3441c88ba334f94fc624d, State: Running, Role: LEADER
I20260809 06:57:55.243279 2072 consensus_queue.cc:237] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b199ab74f6a3441c88ba334f94fc624d" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41879 } }
I20260809 06:57:55.243741 2062 sys_catalog.cc:564] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:55.246672 2073 sys_catalog.cc:455] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b199ab74f6a3441c88ba334f94fc624d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b199ab74f6a3441c88ba334f94fc624d" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41879 } } }
I20260809 06:57:55.247052 2073 sys_catalog.cc:458] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:55.247548 2074 sys_catalog.cc:455] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b199ab74f6a3441c88ba334f94fc624d. Latest consensus state: current_term: 1 leader_uuid: "b199ab74f6a3441c88ba334f94fc624d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b199ab74f6a3441c88ba334f94fc624d" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 41879 } } }
I20260809 06:57:55.247852 2074 sys_catalog.cc:458] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:55.252079 2079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:55.257876 2079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:55.267114 2079 catalog_manager.cc:1347] Generated new cluster ID: a17445bb644d4b3c914cb1092c702135
I20260809 06:57:55.267246 2079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:55.289652 2079 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:55.290995 2079 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:55.297297 2079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b199ab74f6a3441c88ba334f94fc624d: Generated new TSK 0
I20260809 06:57:55.298322 2079 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:55.313284 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1990
W20260809 06:57:55.314497 2057 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54631
W20260809 06:57:55.315304 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 1990: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:57:55.315476 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 1990
2026-08-09T06:57:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2077 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:55 dist-test-slave-0b58 krb5kdc[2095](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:55 dist-test-slave-0b58 krb5kdc[2095](info): set up 2 sockets
Aug 09 06:57:55 dist-test-slave-0b58 krb5kdc[2095](info): commencing operation
krb5kdc: starting...
W20260809 06:57:56.483157 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.002s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:56 dist-test-slave-0b58 krb5kdc[2095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:57:56.820720 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:37295
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:37295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:57.179841 2108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:57.180173 2108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:57.180403 2108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:57.188638 2108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:57.188751 2108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:57.188867 2108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:57.188984 2108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:57.189065 2108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:57.199163 2108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:37295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:37295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:57.200562 2108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:57.202073 2108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:57.213860 2116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:57.213900 2118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:57.214228 2115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:57.214983 2108 server_base.cc:1034] running on GCE node
I20260809 06:57:57.215783 2108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:57.217243 2108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:57.218484 2108 hybrid_clock.cc:648] HybridClock initialized: now 1786258677218435 us; error 42 us; skew 500 ppm
I20260809 06:57:57.218829 2108 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:57 dist-test-slave-0b58 krb5kdc[2095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258677, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:57.227968 2108 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:57:57.229579 2108 webserver.cc:460] Webserver started at http://127.10.205.126:37063/ using document root <none> and password file <none>
I20260809 06:57:57.230288 2108 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:57.230450 2108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:57.230767 2108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:57.233989 2108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "a8d7e82ae2ae4683bad3f154073d4726"
format_stamp: "Formatted at 2026-08-09 06:57:57 on dist-test-slave-0b58"
server_key: "780953fd1ac37e8accb1d26d572924a0"
server_key_iv: "eb7e124cd2dd1a2481676c4bee70f11e"
server_key_version: "encryptionkey@0"
I20260809 06:57:57.234771 2108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "a8d7e82ae2ae4683bad3f154073d4726"
format_stamp: "Formatted at 2026-08-09 06:57:57 on dist-test-slave-0b58"
server_key: "780953fd1ac37e8accb1d26d572924a0"
server_key_iv: "eb7e124cd2dd1a2481676c4bee70f11e"
server_key_version: "encryptionkey@0"
I20260809 06:57:57.239936 2108 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 06:57:57.243328 2125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:57.244668 2108 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:57:57.244848 2108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "a8d7e82ae2ae4683bad3f154073d4726"
format_stamp: "Formatted at 2026-08-09 06:57:57 on dist-test-slave-0b58"
server_key: "780953fd1ac37e8accb1d26d572924a0"
server_key_iv: "eb7e124cd2dd1a2481676c4bee70f11e"
server_key_version: "encryptionkey@0"
I20260809 06:57:57.245050 2108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:57.250771 2108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:57.255204 2108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:57.255554 2108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:57.274251 2108 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:37295
I20260809 06:57:57.274312 2181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:37295 every 8 connection(s)
I20260809 06:57:57.275692 2108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:57.279548 2182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:57.285135 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 2108
I20260809 06:57:57.285342 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:57.285820 11061 external_mini_cluster.cc:1428] Setting key 522379d730e954a0e69bf8477d030e8a
I20260809 06:57:57.291917 2182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726: Bootstrap starting.
I20260809 06:57:57.295161 2186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:57.287749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41087 (local address 127.10.205.126:37295)
0809 06:57:57.288683 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:57.288703 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:57.288766 (+ 63us) server_negotiation.cc:407] Connection header received
0809 06:57:57.291143 (+ 2377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:57.291170 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:57.291598 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:57.292038 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:57.293047 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:57.293055 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:57.293070 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:57.293088 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:57.293185 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:57.293211 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:57.293426 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:57.293569 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 06:57:57.293786 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":407,"threads_started":1}
I20260809 06:57:57.296021 2182 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726: Neither blocks nor log segments found. Creating new log.
I20260809 06:57:57.297236 2182 log.cc:824] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726: Log is configured to *not* fsync() on all Append() calls
I20260809 06:57:57.299036 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:57:57.300805 2182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726: No bootstrap required, opened a new log
I20260809 06:57:57.307235 2186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:57.304437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33821 (local address 127.10.205.126:37295)
0809 06:57:57.304662 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:57.304669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:57.305178 (+ 509us) server_negotiation.cc:407] Connection header received
0809 06:57:57.305391 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:57.305394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:57.305443 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:57.305523 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:57.306526 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:57.306530 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:57.306533 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:57:57.306547 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:57.306587 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:57:57.306605 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:57.306697 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:57.306836 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 06:57:57.306883 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:57:57.311143 2182 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8d7e82ae2ae4683bad3f154073d4726" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 37295 } }
I20260809 06:57:57.311547 2182 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:57:57.311662 2182 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8d7e82ae2ae4683bad3f154073d4726, State: Initialized, Role: FOLLOWER
I20260809 06:57:57.312335 2182 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8d7e82ae2ae4683bad3f154073d4726" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 37295 } }
I20260809 06:57:57.312585 2182 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:57:57.312747 2182 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:57:57.312916 2182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:57:57.315209 2182 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8d7e82ae2ae4683bad3f154073d4726" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 37295 } }
I20260809 06:57:57.315721 2182 leader_election.cc:302] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8d7e82ae2ae4683bad3f154073d4726; no voters:
I20260809 06:57:57.316375 2182 leader_election.cc:288] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:57:57.316516 2193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:57:57.317668 2193 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [term 1 LEADER]: Becoming Leader. State: Replica: a8d7e82ae2ae4683bad3f154073d4726, State: Running, Role: LEADER
I20260809 06:57:57.318295 2193 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8d7e82ae2ae4683bad3f154073d4726" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 37295 } }
I20260809 06:57:57.318805 2182 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:57:57.321285 2195 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8d7e82ae2ae4683bad3f154073d4726. Latest consensus state: current_term: 1 leader_uuid: "a8d7e82ae2ae4683bad3f154073d4726" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8d7e82ae2ae4683bad3f154073d4726" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 37295 } } }
I20260809 06:57:57.321328 2194 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8d7e82ae2ae4683bad3f154073d4726" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8d7e82ae2ae4683bad3f154073d4726" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 37295 } } }
I20260809 06:57:57.322016 2194 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:57.322064 2195 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726 [sys.catalog]: This master's current role is: LEADER
I20260809 06:57:57.323637 2202 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:57:57.329192 2202 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:57:57.338229 2202 catalog_manager.cc:1347] Generated new cluster ID: 04ec36b905d54b59bdcff67cbe96e35b
I20260809 06:57:57.338356 2202 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:57:57.369546 2202 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:57:57.370018 2202 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:57:57.379763 2202 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8d7e82ae2ae4683bad3f154073d4726: Generated new TSK 0
I20260809 06:57:57.380796 2202 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:57:57.392138 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 2108
W20260809 06:57:57.393565 2177 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41087
W20260809 06:57:57.394411 11061 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 2108: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:57:57.394563 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 2108
2026-08-09T06:57:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2078 ms)
[----------] 18 tests from AuthTokenIssuingTest (37439 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:57:57 dist-test-slave-0b58 krb5kdc[2215](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:57:57 dist-test-slave-0b58 krb5kdc[2215](info): set up 2 sockets
Aug 09 06:57:57 dist-test-slave-0b58 krb5kdc[2215](info): commencing operation
krb5kdc: starting...
W20260809 06:57:58.556087 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.002s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:57:58 dist-test-slave-0b58 krb5kdc[2215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:57:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:57:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:57:58.901916 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:45007
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:45007,127.10.205.125:45305,127.10.205.124:46247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:57:59.257171 2228 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 06:57:59.257630 2228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:59.257767 2228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:59.257925 2228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:59.265376 2228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:59.265523 2228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:59.265635 2228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:59.265728 2228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:59.265820 2228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:59.276151 2228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:45007,127.10.205.125:45305,127.10.205.124:46247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:45007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:59.277633 2228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:59.279017 2228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:59.291469 2233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:59.291441 2235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:59.291417 2237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:59.291869 2228 server_base.cc:1034] running on GCE node
I20260809 06:57:59.292907 2228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:59.294355 2228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:59.295609 2228 hybrid_clock.cc:648] HybridClock initialized: now 1786258679295545 us; error 56 us; skew 500 ppm
I20260809 06:57:59.295948 2228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:59 dist-test-slave-0b58 krb5kdc[2215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258679, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:59.299137 2228 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:57:59.300729 2228 webserver.cc:460] Webserver started at http://127.10.205.126:40209/ using document root <none> and password file <none>
I20260809 06:57:59.301395 2228 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:59.301483 2228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:59.301754 2228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:59.304927 2228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "7decfaf4b1e945a195aeb2e165e4ca76"
format_stamp: "Formatted at 2026-08-09 06:57:59 on dist-test-slave-0b58"
server_key: "b1422d4ebf398a7ffd6bcf1afe46b6cf"
server_key_iv: "0267ef76e2972c82830fff911ac232f7"
server_key_version: "encryptionkey@0"
I20260809 06:57:59.305733 2228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "7decfaf4b1e945a195aeb2e165e4ca76"
format_stamp: "Formatted at 2026-08-09 06:57:59 on dist-test-slave-0b58"
server_key: "b1422d4ebf398a7ffd6bcf1afe46b6cf"
server_key_iv: "0267ef76e2972c82830fff911ac232f7"
server_key_version: "encryptionkey@0"
I20260809 06:57:59.310879 2228 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:57:59.314273 2244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:59.315582 2228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:57:59.315764 2228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "7decfaf4b1e945a195aeb2e165e4ca76"
format_stamp: "Formatted at 2026-08-09 06:57:59 on dist-test-slave-0b58"
server_key: "b1422d4ebf398a7ffd6bcf1afe46b6cf"
server_key_iv: "0267ef76e2972c82830fff911ac232f7"
server_key_version: "encryptionkey@0"
I20260809 06:57:59.316001 2228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:59.334265 2228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:59.339008 2228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:59.339355 2228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:59.359001 2228 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:45007
I20260809 06:57:59.359023 2301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:45007 every 8 connection(s)
I20260809 06:57:59.360427 2228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:57:59.364200 2302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:59.367079 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 2228
I20260809 06:57:59.367316 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:57:59.368146 11061 external_mini_cluster.cc:1428] Setting key 9b6807649513a055d741e530d46c9ce5
I20260809 06:57:59.373824 2302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:57:59 dist-test-slave-0b58 krb5kdc[2215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258679, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:59.398136 2306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.377874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33828 (local address 127.10.205.126:45007)
0809 06:57:59.380646 (+ 2772us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:59.380656 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:59.380710 (+ 54us) server_negotiation.cc:407] Connection header received
0809 06:57:59.381143 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:59.381154 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:59.381475 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:59.381700 (+ 225us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:59.382848 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:59.384805 (+ 1957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:59.386214 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:59.386768 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:59.386973 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:59.390664 (+ 3691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:59.390672 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:59.390685 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:59.390718 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:59.393558 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:59.394305 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:59.394312 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:59.394314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:59.394464 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:59.394850 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:59.394858 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:59.394862 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:59.395401 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:59.395629 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:59.396190 (+ 561us) server_negotiation.cc:299] Negotiation successful
0809 06:57:59.396622 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":2514,"spinlock_wait_cycles":29056,"thread_start_us":467,"threads_started":1}
I20260809 06:57:59.398177 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.377874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45007 (local address 127.0.0.1:33828)
0809 06:57:59.378816 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.378878 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:59.380755 (+ 1877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:59.381715 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:59.381719 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:59.382291 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:59.382632 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:59.382648 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:59.384961 (+ 2313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:59.384968 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:59.386034 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:59.386046 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:59.387010 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:59.387018 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:59.387212 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:59.387912 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:57:59.387935 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:59.390444 (+ 2509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:59.393709 (+ 3265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:59.393721 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:59.393738 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:59.394152 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:59.394576 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:59.394582 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:59.394585 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:59.394739 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:59.395560 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:59.395571 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:59.395814 (+ 243us) client_negotiation.cc:769] Sending connection context
0809 06:57:59.396074 (+ 260us) client_negotiation.cc:240] Negotiation successful
0809 06:57:59.396743 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"mutex_wait_us":158,"thread_start_us":428,"threads_started":1}
I20260809 06:57:59.401414 2302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.205.125@KRBTEST.COM; defaulting to no policy
I20260809 06:57:59.402710 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.402284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34080)
0809 06:57:59.402489 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.402594 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260809 06:57:59.402983 2248 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
I20260809 06:57:59.404513 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.404127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34086)
0809 06:57:59.404324 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.404398 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 06:57:59.404731 2302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:45305: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.125.keytab.
Entry for principal kudu/127.10.205.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.125.keytab.
I20260809 06:57:59.444917 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.125:45305
--webserver_interface=127.10.205.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.125.keytab
--principal=kudu/127.10.205.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:45007,127.10.205.125:45305,127.10.205.124:46247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:57:59.454085 2302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } attempt: 1
I20260809 06:57:59.455351 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.454841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34102)
0809 06:57:59.455055 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.455185 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 06:57:59.456391 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.455977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34112)
0809 06:57:59.456122 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.456211 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 06:57:59.456581 2302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:45305: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
I20260809 06:57:59.524855 2302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } attempt: 2
I20260809 06:57:59.526192 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.525587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34122)
0809 06:57:59.525877 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.525994 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260809 06:57:59.527298 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.526882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34128)
0809 06:57:59.527051 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.527138 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 06:57:59.527513 2302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:45305: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
I20260809 06:57:59.618829 2302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } attempt: 3
I20260809 06:57:59.620107 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.619569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34134)
0809 06:57:59.619816 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.619936 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 06:57:59.621210 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.620807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34146)
0809 06:57:59.620959 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.621047 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 06:57:59.621423 2302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:45305: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
I20260809 06:57:59.764707 2302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } attempt: 4
I20260809 06:57:59.766104 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.765431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34158)
0809 06:57:59.765796 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.765917 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189}
I20260809 06:57:59.767175 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.766804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34170)
0809 06:57:59.766976 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.767055 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260809 06:57:59.767396 2302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:45305: Network error: Client connection negotiation failed: client connection to 127.10.205.125:45305: connect: Connection refused (error 111)
W20260809 06:57:59.789369 2310 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 06:57:59.789723 2310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:57:59.789829 2310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:57:59.789980 2310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:57:59.797227 2310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:57:59.797389 2310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:57:59.797515 2310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:57:59.797608 2310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:57:59.797703 2310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:57:59.807991 2310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:45007,127.10.205.125:45305,127.10.205.124:46247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.125.keytab
--principal=kudu/127.10.205.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.125:45305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.205.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:57:59.809445 2310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:57:59.810817 2310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:57:59.822914 2318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:59.823031 2316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:57:59.823158 2315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:57:59.824038 2310 server_base.cc:1034] running on GCE node
I20260809 06:57:59.824877 2310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:57:59.826373 2310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:57:59.827621 2310 hybrid_clock.cc:648] HybridClock initialized: now 1786258679827557 us; error 42 us; skew 500 ppm
I20260809 06:57:59.828027 2310 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:57:59 dist-test-slave-0b58 krb5kdc[2215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258679, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:57:59.831209 2310 init.cc:377] Logged in from keytab as kudu/127.10.205.125@KRBTEST.COM (short username kudu)
I20260809 06:57:59.832660 2310 webserver.cc:460] Webserver started at http://127.10.205.125:40031/ using document root <none> and password file <none>
I20260809 06:57:59.833348 2310 fs_manager.cc:359] Metadata directory not provided
I20260809 06:57:59.833436 2310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:57:59.833705 2310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:57:59.836877 2310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/data/instance:
uuid: "df0d7ec48b274b69915ce083da47ce9b"
format_stamp: "Formatted at 2026-08-09 06:57:59 on dist-test-slave-0b58"
server_key: "0ccf62558680eb4cec13cd84b3979b28"
server_key_iv: "0ee7723416c69891f91d479e5819905e"
server_key_version: "encryptionkey@0"
I20260809 06:57:59.837636 2310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/wal/instance:
uuid: "df0d7ec48b274b69915ce083da47ce9b"
format_stamp: "Formatted at 2026-08-09 06:57:59 on dist-test-slave-0b58"
server_key: "0ccf62558680eb4cec13cd84b3979b28"
server_key_iv: "0ee7723416c69891f91d479e5819905e"
server_key_version: "encryptionkey@0"
I20260809 06:57:59.842971 2310 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 06:57:59.846407 2325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:57:59.847776 2310 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:57:59.847929 2310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/wal
uuid: "df0d7ec48b274b69915ce083da47ce9b"
format_stamp: "Formatted at 2026-08-09 06:57:59 on dist-test-slave-0b58"
server_key: "0ccf62558680eb4cec13cd84b3979b28"
server_key_iv: "0ee7723416c69891f91d479e5819905e"
server_key_version: "encryptionkey@0"
I20260809 06:57:59.848116 2310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:57:59.865989 2310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:57:59.870277 2310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:57:59.870556 2310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:57:59.888857 2310 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.125:45305
I20260809 06:57:59.888893 2378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.125:45305 every 8 connection(s)
I20260809 06:57:59.890267 2310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
I20260809 06:57:59.893853 2379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:57:59.899590 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 2310
I20260809 06:57:59.899784 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-1/wal/instance
I20260809 06:57:59.900367 11061 external_mini_cluster.cc:1428] Setting key 26e5487facaac166c639e7ae99bdb102
I20260809 06:57:59.900727 2379 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:57:59 dist-test-slave-0b58 krb5kdc[2215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258679, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.125@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:57:59.926462 2381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.904017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33836 (local address 127.10.205.126:45007)
0809 06:57:59.904603 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:59.904610 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:59.905597 (+ 987us) server_negotiation.cc:407] Connection header received
0809 06:57:59.908549 (+ 2952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:59.908554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:59.908623 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:59.908718 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:59.910983 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:59.911752 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:59.914267 (+ 2515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:59.914689 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:59.914795 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:59.918671 (+ 3876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:59.918680 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:59.918688 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:59.918750 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:59.922771 (+ 4021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:59.923596 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:59.923605 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:59.923611 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:59.923773 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:59.924225 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:59.924233 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:59.924238 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:59.924699 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:59.924856 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:59.925627 (+ 771us) server_negotiation.cc:299] Negotiation successful
0809 06:57:59.925918 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":302,"threads_started":1}
I20260809 06:57:59.927043 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.904581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45007 (local address 127.0.0.1:33836)
0809 06:57:59.905414 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.905465 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:59.908212 (+ 2747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:59.909007 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:59.909020 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:59.909818 (+ 798us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:59.910674 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:59.910702 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:59.911934 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:59.911942 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:59.914050 (+ 2108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:59.914069 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:59.914947 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:59.914957 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:59.915302 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:59.916133 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:57:59.916156 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:59.918412 (+ 2256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:59.922945 (+ 4533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:59.922954 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:59.922970 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:59.923449 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:59.923889 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:59.923892 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:59.923894 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:59.924077 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:59.924843 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:59.924849 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:59.925207 (+ 358us) client_negotiation.cc:769] Sending connection context
0809 06:57:59.925443 (+ 236us) client_negotiation.cc:240] Negotiation successful
0809 06:57:59.925859 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":304,"threads_started":1}
I20260809 06:57:59.928956 2379 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.205.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.124@KRBTEST.COM" created.
Aug 09 06:57:59 dist-test-slave-0b58 krb5kdc[2215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258679, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.125@KRBTEST.COM for kudu/127.10.205.125@KRBTEST.COM
I20260809 06:57:59.946225 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.929848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34176)
0809 06:57:59.930039 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.930065 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 06:57:59.930153 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:57:59.931123 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:57:59.931128 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:57:59.931605 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:57:59.931734 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:59.931742 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:59.933310 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:59.933318 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:59.934170 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:57:59.934182 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:57:59.935080 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:57:59.935086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:57:59.935296 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:59.936027 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:57:59.936044 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:57:59.939258 (+ 3214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:57:59.943747 (+ 4489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:59.943751 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:59.943754 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:59.944120 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:59.944573 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:57:59.944577 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:57:59.944579 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:57:59.944707 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:57:59.945461 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:57:59.945464 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:57:59.945580 (+ 116us) client_negotiation.cc:769] Sending connection context
0809 06:57:59.945685 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 06:57:59.945901 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"mutex_wait_us":23}
I20260809 06:57:59.946734 2384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.930063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34176 (local address 127.10.205.125:45305)
0809 06:57:59.930716 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0809 06:57:59.930721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:57:59.930747 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:57:59.930789 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:57:59.930795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:57:59.930979 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:57:59.931133 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:57:59.931921 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:59.933175 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:59.934311 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:57:59.934929 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:57:59.935067 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:57:59.939505 (+ 4438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:57:59.939522 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:57:59.939544 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:57:59.939596 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:57:59.943592 (+ 3996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:59.944251 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:59.944286 (+ 35us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:59.944292 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:59.944450 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:57:59.944811 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:57:59.944818 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:57:59.944823 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:57:59.945334 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:57:59.945548 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 06:57:59.945878 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 06:57:59.946186 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":511,"thread_start_us":370,"threads_started":1}
I20260809 06:57:59.949424 2379 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:57:59.950593 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.950126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45028)
0809 06:57:59.950340 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.950442 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260809 06:57:59.950841 2329 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
I20260809 06:57:59.952510 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:57:59.952112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45030)
0809 06:57:59.952323 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 06:57:59.952409 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 06:57:59.952785 2379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:46247: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.124.keytab.
Entry for principal kudu/127.10.205.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.124.keytab.
I20260809 06:57:59.977605 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.124:46247
--webserver_interface=127.10.205.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.124.keytab
--principal=kudu/127.10.205.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:38511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:45007,127.10.205.125:45305,127.10.205.124:46247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:58:00.002154 2379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } attempt: 1
I20260809 06:58:00.003584 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.003042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45046)
0809 06:58:00.003270 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.003412 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 06:58:00.004738 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.004402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45056)
0809 06:58:00.004554 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.004630 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 06:58:00.005025 2379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:46247: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
I20260809 06:58:00.066696 2302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } attempt: 5
I20260809 06:58:00.073259 2379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } attempt: 2
Aug 09 06:58:00 dist-test-slave-0b58 krb5kdc[2215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258679, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for kudu/127.10.205.125@KRBTEST.COM
I20260809 06:58:00.074327 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.073804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45070)
0809 06:58:00.074014 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.074128 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 06:58:00.075541 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.075140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45078)
0809 06:58:00.075295 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.075401 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 06:58:00.075803 2379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:46247: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
I20260809 06:58:00.081079 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.067492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34182)
0809 06:58:00.067691 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.067714 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:00.067848 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:00.068284 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:00.068291 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:00.068698 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:00.068888 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:00.068897 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.069848 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.069856 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:00.070722 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:00.070734 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.071517 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.071541 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:00.071749 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.072452 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:00.072470 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:00.074787 (+ 2317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:00.078878 (+ 4091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:00.078882 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:00.078885 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:00.079219 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:00.079630 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:00.079634 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:00.079636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:00.079760 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:00.080380 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:00.080384 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:00.080508 (+ 124us) client_negotiation.cc:769] Sending connection context
0809 06:58:00.080623 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 06:58:00.080855 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 06:58:00.081272 2384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.067621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34182 (local address 127.10.205.125:45305)
0809 06:58:00.067811 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.067816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.067854 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:58:00.068022 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.068026 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.068089 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.068199 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.069038 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.069714 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.070878 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.071345 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.071490 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.075014 (+ 3524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:00.075022 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:00.075029 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:00.075075 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:00.078733 (+ 3658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.079336 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.079341 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.079345 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.079488 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.079865 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.079870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.079873 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.080229 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:00.080417 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:00.080763 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 06:58:00.080993 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:58:00.082320 2302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:58:00.083397 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.082904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45084)
0809 06:58:00.083113 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.083221 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260809 06:58:00.084412 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.083989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45096)
0809 06:58:00.084148 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.084247 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 06:58:00.084617 2302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:46247: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
I20260809 06:58:00.135876 2302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } attempt: 1
I20260809 06:58:00.137212 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.136663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45106)
0809 06:58:00.136890 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.137006 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 06:58:00.138236 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.137876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45114)
0809 06:58:00.138023 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.138107 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 06:58:00.138525 2302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:46247: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
I20260809 06:58:00.167052 2379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } attempt: 3
I20260809 06:58:00.168315 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.167764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45118)
0809 06:58:00.167992 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.168104 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 06:58:00.169570 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.169136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45130)
0809 06:58:00.169379 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.169454 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
W20260809 06:58:00.169787 2379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:46247: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
I20260809 06:58:00.206784 2302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } attempt: 2
I20260809 06:58:00.208151 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.207544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45134)
0809 06:58:00.207835 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.207948 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 06:58:00.209224 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.208839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45142)
0809 06:58:00.209014 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.209098 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 06:58:00.209479 2302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:46247: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
I20260809 06:58:00.313088 2379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } attempt: 4
I20260809 06:58:00.314317 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.313815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45152)
0809 06:58:00.314061 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.314155 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260809 06:58:00.315276 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.314974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45156)
0809 06:58:00.315113 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.315182 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 06:58:00.315498 2379 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:46247: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
I20260809 06:58:00.315701 2302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } attempt: 3
I20260809 06:58:00.316697 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.316302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45168)
0809 06:58:00.316479 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.316555 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 06:58:00.317672 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.317375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45170)
0809 06:58:00.317520 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.317587 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 06:58:00.317934 2302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:46247: Network error: Client connection negotiation failed: client connection to 127.10.205.124:46247: connect: Connection refused (error 111)
W20260809 06:58:00.332152 2387 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 06:58:00.332615 2387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:58:00.332732 2387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:58:00.332887 2387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:58:00.340153 2387 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:58:00.340327 2387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:58:00.340428 2387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:58:00.340477 2387 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:58:00.340543 2387 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:58:00.350749 2387 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:38511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:45007,127.10.205.125:45305,127.10.205.124:46247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.124.keytab
--principal=kudu/127.10.205.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.124:46247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.205.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:58:00.352136 2387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:58:00.353711 2387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:58:00.366993 2393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:58:00.367547 2394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:58:00.368077 2396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:58:00.368492 2387 server_base.cc:1034] running on GCE node
I20260809 06:58:00.369505 2387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:58:00.370959 2387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:58:00.372176 2387 hybrid_clock.cc:648] HybridClock initialized: now 1786258680372111 us; error 46 us; skew 500 ppm
I20260809 06:58:00.372570 2387 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:58:00 dist-test-slave-0b58 krb5kdc[2215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258680, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:58:00.375707 2387 init.cc:377] Logged in from keytab as kudu/127.10.205.124@KRBTEST.COM (short username kudu)
I20260809 06:58:00.377341 2387 webserver.cc:460] Webserver started at http://127.10.205.124:46531/ using document root <none> and password file <none>
I20260809 06:58:00.378105 2387 fs_manager.cc:359] Metadata directory not provided
I20260809 06:58:00.378240 2387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:58:00.378573 2387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:58:00.381865 2387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/data/instance:
uuid: "0dca7cbac1984321b860fa96990483a7"
format_stamp: "Formatted at 2026-08-09 06:58:00 on dist-test-slave-0b58"
server_key: "ab031207bca94673eb4c28cf0a38c622"
server_key_iv: "a4ee7f1f1ffdd72aac8bc463803b4f95"
server_key_version: "encryptionkey@0"
I20260809 06:58:00.382679 2387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/wal/instance:
uuid: "0dca7cbac1984321b860fa96990483a7"
format_stamp: "Formatted at 2026-08-09 06:58:00 on dist-test-slave-0b58"
server_key: "ab031207bca94673eb4c28cf0a38c622"
server_key_iv: "a4ee7f1f1ffdd72aac8bc463803b4f95"
server_key_version: "encryptionkey@0"
I20260809 06:58:00.388006 2387 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260809 06:58:00.391536 2403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:58:00.392885 2387 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:58:00.393069 2387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/wal
uuid: "0dca7cbac1984321b860fa96990483a7"
format_stamp: "Formatted at 2026-08-09 06:58:00 on dist-test-slave-0b58"
server_key: "ab031207bca94673eb4c28cf0a38c622"
server_key_iv: "a4ee7f1f1ffdd72aac8bc463803b4f95"
server_key_version: "encryptionkey@0"
I20260809 06:58:00.393301 2387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:58:00.413410 2387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:58:00.417600 2387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:58:00.417906 2387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:58:00.437251 2387 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.124:46247
I20260809 06:58:00.437254 2457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.124:46247 every 8 connection(s)
I20260809 06:58:00.438728 2387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
I20260809 06:58:00.442517 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 2387
I20260809 06:58:00.442688 2458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:58:00.442730 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786258311159624-11061-0/minicluster-data/master-2/wal/instance
I20260809 06:58:00.443295 11061 external_mini_cluster.cc:1428] Setting key 8129382d96836c59c16602e52012ec08
I20260809 06:58:00.452649 2458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:58:00 dist-test-slave-0b58 krb5kdc[2215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.124@KRBTEST.COM
Aug 09 06:58:00 dist-test-slave-0b58 krb5kdc[2215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258680, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.124@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:58:00.467725 2461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.445295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45172 (local address 127.10.205.124:46247)
0809 06:58:00.446140 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.446151 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.446212 (+ 61us) server_negotiation.cc:407] Connection header received
0809 06:58:00.447815 (+ 1603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.447837 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.448227 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.448634 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.450524 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.451852 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.453351 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.454088 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.454283 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.459787 (+ 5504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:00.459795 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:00.459809 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:00.459847 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:00.463319 (+ 3472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.464233 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.464242 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.464252 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.464494 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.464913 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.464917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.464919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.465452 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:00.465779 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:00.466232 (+ 453us) server_negotiation.cc:299] Negotiation successful
0809 06:58:00.466661 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":401,"threads_started":1}
I20260809 06:58:00.471149 2463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.455272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:45007 (local address 127.0.0.1:33838)
0809 06:58:00.456060 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.456100 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:00.456292 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:00.456718 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:00.456723 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:00.457322 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:00.457572 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:00.457580 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.458728 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.458735 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:00.460173 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:00.460186 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.461208 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.461213 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:00.461353 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.462123 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:00.462141 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:00.464710 (+ 2569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:00.468343 (+ 3633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:00.468357 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:00.468372 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:00.468917 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:00.469384 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:00.469389 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:00.469393 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:00.469522 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:00.470041 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:00.470046 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:00.470303 (+ 257us) client_negotiation.cc:769] Sending connection context
0809 06:58:00.470453 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 06:58:00.470730 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":403,"threads_started":1}
I20260809 06:58:00.471287 2462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.455252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33838 (local address 127.10.205.126:45007)
0809 06:58:00.455804 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.455811 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.456214 (+ 403us) server_negotiation.cc:407] Connection header received
0809 06:58:00.456440 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.456447 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.456539 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.456666 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.457738 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.458546 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.460367 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.460983 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.461118 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.464918 (+ 3800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:00.464928 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:00.464937 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:00.464975 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:00.468182 (+ 3207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.469099 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.469106 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.469112 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.469260 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.469641 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.469646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.469649 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.469917 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:00.470108 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:00.470618 (+ 510us) server_negotiation.cc:299] Negotiation successful
0809 06:58:00.470832 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":269,"threads_started":1}
I20260809 06:58:00.472908 2458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:58:00 dist-test-slave-0b58 krb5kdc[2215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
Aug 09 06:58:00 dist-test-slave-0b58 krb5kdc[2215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258680, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.124@KRBTEST.COM for kudu/127.10.205.125@KRBTEST.COM
I20260809 06:58:00.487243 2462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.471078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33842 (local address 127.10.205.126:45007)
0809 06:58:00.471514 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.471519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.471535 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:58:00.471596 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.471603 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.471739 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.471923 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.473463 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.474478 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.475685 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.476098 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.476226 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.480916 (+ 4690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:00.480924 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:00.480931 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:00.480974 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:00.484533 (+ 3559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.485168 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.485171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.485174 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.485298 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.485726 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.485732 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.485736 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.486025 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:00.486326 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:00.486631 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 06:58:00.486865 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":651,"threads_started":1}
I20260809 06:58:00.487629 2463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.473771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:45305 (local address 127.0.0.1:34196)
0809 06:58:00.473996 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.474010 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:00.474092 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:00.474391 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:00.474394 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:00.474703 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:00.474852 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:00.474860 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.475831 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.475839 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:00.476870 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:00.476886 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.477912 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.477916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:00.478039 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.478585 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:00.478602 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:00.480868 (+ 2266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:00.485199 (+ 4331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:00.485203 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:00.485205 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:00.485592 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:00.486007 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:00.486012 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:00.486017 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:00.486172 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:00.486698 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:00.486702 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:00.486867 (+ 165us) client_negotiation.cc:769] Sending connection context
0809 06:58:00.487007 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 06:58:00.487298 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145}
I20260809 06:58:00.488086 2384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.473741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34196 (local address 127.10.205.125:45305)
0809 06:58:00.473953 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.473960 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.474074 (+ 114us) server_negotiation.cc:407] Connection header received
0809 06:58:00.474193 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.474199 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.474274 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.474364 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.475003 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.475688 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.477049 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.477759 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.477906 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.481060 (+ 3154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:00.481066 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:00.481070 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:00.481113 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:00.484526 (+ 3413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.485720 (+ 1194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.485728 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.485733 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.485887 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.486292 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.486303 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.486306 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.486573 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:00.486732 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:00.487482 (+ 750us) server_negotiation.cc:299] Negotiation successful
0809 06:58:00.487721 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:58:00.489084 2458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:58:00.495172 2302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } attempt: 4
Aug 09 06:58:00 dist-test-slave-0b58 krb5kdc[2215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258680, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.124@KRBTEST.COM for kudu/127.10.205.124@KRBTEST.COM
Aug 09 06:58:00 dist-test-slave-0b58 krb5kdc[2215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.125@KRBTEST.COM
I20260809 06:58:00.505554 2461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.489847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45186 (local address 127.10.205.124:46247)
0809 06:58:00.489975 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.489982 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.490000 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:58:00.490196 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.490201 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.490266 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.490352 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.491333 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.492356 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.493891 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.494369 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.494486 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.499247 (+ 4761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:00.499253 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:00.499259 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:00.499293 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:00.502959 (+ 3666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.503569 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.503576 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.503579 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.503704 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.504044 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.504051 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.504054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.504422 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:00.504569 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:00.504904 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 06:58:00.505166 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 06:58:00.505656 2463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.489774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45186)
0809 06:58:00.489947 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.489963 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:00.490062 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:00.490405 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:00.490409 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:00.490958 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:00.491172 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:00.491185 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.492476 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.492480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:00.493745 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:00.493771 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.494528 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.494533 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:00.494684 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.495516 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:00.495541 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:00.499065 (+ 3524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:00.503084 (+ 4019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:00.503089 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:00.503093 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:00.503444 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:00.503814 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:00.503820 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:00.503823 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:00.503949 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:00.504531 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:00.504535 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:00.504685 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 06:58:00.504829 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 06:58:00.505322 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":149}
I20260809 06:58:00.507296 2384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.489281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34210 (local address 127.10.205.125:45305)
0809 06:58:00.489432 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.489437 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.489455 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:58:00.489980 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.489984 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.490038 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.490109 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.491746 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.492672 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.494273 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.494815 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.494904 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.500230 (+ 5326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:00.500237 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:00.500241 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:00.500324 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:00.503741 (+ 3417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.504673 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.504679 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.504682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.504850 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.505327 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.505332 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.505335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.505694 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:00.505995 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:00.506835 (+ 840us) server_negotiation.cc:299] Negotiation successful
0809 06:58:00.507013 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 06:58:00.511606 2458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7: Bootstrap starting.
I20260809 06:58:00.512231 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
Aug 09 06:58:00 dist-test-slave-0b58 krb5kdc[2215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258679, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for kudu/127.10.205.124@KRBTEST.COM
I20260809 06:58:00.515854 2458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7: Neither blocks nor log segments found. Creating new log.
I20260809 06:58:00.517416 2458 log.cc:824] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7: Log is configured to *not* fsync() on all Append() calls
I20260809 06:58:00.520162 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.495896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45198)
0809 06:58:00.496085 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.496108 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:00.496218 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:00.500399 (+ 4181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:00.500407 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:00.500850 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:00.501105 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:00.501121 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.502884 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.502890 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:00.504434 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:00.504452 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.505510 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.505516 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:00.505726 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.506402 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:00.506435 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:00.513285 (+ 6850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:00.517293 (+ 4008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:00.517302 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:00.517306 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:00.517856 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:00.518267 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:00.518272 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:00.518276 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:00.518451 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:00.518995 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:00.519000 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:00.519227 (+ 227us) client_negotiation.cc:769] Sending connection context
0809 06:58:00.519414 (+ 187us) client_negotiation.cc:240] Negotiation successful
0809 06:58:00.519763 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 06:58:00.520212 2465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.495974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45198 (local address 127.10.205.124:46247)
0809 06:58:00.499037 (+ 3063us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.499043 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.499068 (+ 25us) server_negotiation.cc:407] Connection header received
0809 06:58:00.499119 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.499125 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.500194 (+ 1069us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.500360 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.501297 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.502726 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.504621 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.505332 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.508446 (+ 3114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.513535 (+ 5089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:00.513541 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:00.513546 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:00.513594 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:00.517131 (+ 3537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.517996 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.518001 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.518005 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.518143 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.518573 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.518577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.518581 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.518871 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:00.519023 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:00.519543 (+ 520us) server_negotiation.cc:299] Negotiation successful
0809 06:58:00.519750 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2927,"thread_start_us":2670,"threads_started":1}
I20260809 06:58:00.515583 2275 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7decfaf4b1e945a195aeb2e165e4ca76"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33842
I20260809 06:58:00.524288 2458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7: No bootstrap required, opened a new log
I20260809 06:58:00.525269 2302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76: Bootstrap starting.
I20260809 06:58:00.528396 2302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76: Neither blocks nor log segments found. Creating new log.
I20260809 06:58:00.529455 2302 log.cc:824] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76: Log is configured to *not* fsync() on all Append() calls
I20260809 06:58:00.532584 2302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76: No bootstrap required, opened a new log
I20260809 06:58:00.535022 2458 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } }
I20260809 06:58:00.535476 2458 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dca7cbac1984321b860fa96990483a7, State: Initialized, Role: FOLLOWER
I20260809 06:58:00.535919 2458 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } }
I20260809 06:58:00.536887 2468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } } }
I20260809 06:58:00.537320 2468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:00.538162 2458 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:58:00.538678 2302 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } }
I20260809 06:58:00.539003 2302 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7decfaf4b1e945a195aeb2e165e4ca76, State: Initialized, Role: FOLLOWER
I20260809 06:58:00.539520 2302 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } }
I20260809 06:58:00.540802 2472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } } }
I20260809 06:58:00.541432 2472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:00.541941 2302 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:58:00.541985 2275 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 06:58:00.542160 2275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:58:00.546432 2275 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } }
I20260809 06:58:00.548375 2275 leader_election.cc:288] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [CANDIDATE]: Term 1 election: Requested vote from peers df0d7ec48b274b69915ce083da47ce9b (127.10.205.125:45305), 0dca7cbac1984321b860fa96990483a7 (127.10.205.124:46247)
I20260809 06:58:00.549642 2432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0dca7cbac1984321b860fa96990483a7"
I20260809 06:58:00.550360 2432 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:58:00.555061 2432 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7decfaf4b1e945a195aeb2e165e4ca76 in term 1.
I20260809 06:58:00.556051 2248 leader_election.cc:302] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dca7cbac1984321b860fa96990483a7, 7decfaf4b1e945a195aeb2e165e4ca76; no voters:
I20260809 06:58:00.556762 2472 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:58:00.560599 2472 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [term 1 LEADER]: Becoming Leader. State: Replica: 7decfaf4b1e945a195aeb2e165e4ca76, State: Running, Role: LEADER
I20260809 06:58:00.561528 2472 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } }
I20260809 06:58:00.573132 2484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7decfaf4b1e945a195aeb2e165e4ca76. Latest consensus state: current_term: 1 leader_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } } }
I20260809 06:58:00.573752 2484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [sys.catalog]: This master's current role is: LEADER
I20260809 06:58:00.574405 2496 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 06:58:00.585786 2497 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260809 06:58:00.592531 2250 tablet.cc:2369] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:58:00.580096 2228 master_runner.cc:186] Error getting master registration for 127.10.205.125:45305: OK, instance_id { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" instance_seqno: 1786258679883471 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 06:58:00.600279 2497 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:58:00.604622 2228 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 06:58:00.614553 2432 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [term 1 FOLLOWER]: Refusing update from remote peer 7decfaf4b1e945a195aeb2e165e4ca76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:58:00.614720 2379 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } attempt: 5
I20260809 06:58:00.615648 2484 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Aug 09 06:58:00 dist-test-slave-0b58 krb5kdc[2215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258679, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.125@KRBTEST.COM for kudu/127.10.205.124@KRBTEST.COM
I20260809 06:58:00.626381 2500 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 06:58:00.631750 2462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.591250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51702 (local address 127.10.205.126:45007)
0809 06:58:00.591484 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.591492 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.597783 (+ 6291us) server_negotiation.cc:407] Connection header received
0809 06:58:00.599407 (+ 1624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.599412 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.599498 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.599574 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.608617 (+ 9043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.609868 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.611826 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.612494 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.612596 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.618466 (+ 5870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:00.618475 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:00.618482 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:00.618529 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:00.622745 (+ 4216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.629061 (+ 6316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.629066 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.629070 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.629277 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.629779 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.629788 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.629793 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.630150 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:00.630404 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:00.631108 (+ 704us) server_negotiation.cc:299] Negotiation successful
0809 06:58:00.631376 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 06:58:00.634346 2461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.616077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45708 (local address 127.10.205.124:46247)
0809 06:58:00.616293 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.616301 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.616320 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:58:00.616372 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.616377 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.616455 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.616554 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.617846 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.618974 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.621170 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.621861 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.621983 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.626521 (+ 4538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:00.626528 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:00.626533 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:00.626577 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:00.630459 (+ 3882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.631332 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.631338 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.631343 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.631497 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.632283 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.632289 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.632295 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.632685 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:00.632892 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:00.633766 (+ 874us) server_negotiation.cc:299] Negotiation successful
0809 06:58:00.633986 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:58:00.635149 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.615330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:46247 (local address 127.0.0.1:45708)
0809 06:58:00.615728 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:00.615751 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:00.615860 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:00.616911 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:00.616916 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:00.617459 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:00.617659 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:00.617670 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.619516 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.619523 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:00.620995 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:00.621011 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.622232 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.622238 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:00.622529 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.623196 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:00.623226 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:00.626296 (+ 3070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:00.630635 (+ 4339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:00.630643 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:00.630650 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:00.631185 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:00.631627 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:00.631632 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:00.631636 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:00.632115 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:00.632960 (+ 845us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:00.632966 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:00.633140 (+ 174us) client_negotiation.cc:769] Sending connection context
0809 06:58:00.633311 (+ 171us) client_negotiation.cc:240] Negotiation successful
0809 06:58:00.634745 (+ 1434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":1}
I20260809 06:58:00.641606 2468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7decfaf4b1e945a195aeb2e165e4ca76. Latest consensus state: current_term: 1 leader_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } } }
I20260809 06:58:00.641992 2468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:00.642560 2379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b: Bootstrap starting.
I20260809 06:58:00.647055 2379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b: Neither blocks nor log segments found. Creating new log.
I20260809 06:58:00.648743 2379 log.cc:824] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b: Log is configured to *not* fsync() on all Append() calls
I20260809 06:58:00.643878 2387 master_runner.cc:186] Error getting master registration for 127.10.205.125:45305: OK, instance_id { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" instance_seqno: 1786258679883471 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 06:58:00.655655 2387 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 06:58:00.658949 2379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b: No bootstrap required, opened a new log
I20260809 06:58:00.662719 2468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } } }
I20260809 06:58:00.663014 2468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:00.668074 2484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } } }
I20260809 06:58:00.668455 2484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [sys.catalog]: This master's current role is: LEADER
I20260809 06:58:00.672875 2497 catalog_manager.cc:1347] Generated new cluster ID: 70448fcdf9c742c0a816e3dc282e419f
I20260809 06:58:00.672998 2497 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:58:00.678617 2465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.598530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45696 (local address 127.10.205.124:46247)
0809 06:58:00.598774 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.598783 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.609090 (+ 10307us) server_negotiation.cc:407] Connection header received
0809 06:58:00.610039 (+ 949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.610048 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.610192 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.610292 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.619451 (+ 9159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.620651 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.631517 (+ 10866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.632239 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.632360 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.667148 (+ 34788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:00.667156 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:00.667161 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:00.667213 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:00.671201 (+ 3988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.675569 (+ 4368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.675576 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.675580 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.675734 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.676558 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.676564 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.676567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.676928 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:00.677138 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:00.678017 (+ 879us) server_negotiation.cc:299] Negotiation successful
0809 06:58:00.678267 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70,"spinlock_wait_cycles":3968}
I20260809 06:58:00.682389 2384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:00.590725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57924 (local address 127.10.205.125:45305)
0809 06:58:00.590926 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.590933 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.606185 (+ 15252us) server_negotiation.cc:407] Connection header received
0809 06:58:00.606896 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.606906 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.607025 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.607118 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.617005 (+ 9887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.618151 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.629601 (+ 11450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:00.630315 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:00.630421 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:00.671454 (+ 41033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:00.671463 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:00.671468 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:00.671519 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:00.675380 (+ 3861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.679596 (+ 4216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.679601 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.679604 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.679797 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:00.680486 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:00.680490 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:00.680493 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:00.680865 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:00.681081 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:00.681804 (+ 723us) server_negotiation.cc:299] Negotiation successful
0809 06:58:00.682038 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 06:58:00.683979 2379 raft_consensus.cc:348] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } }
I20260809 06:58:00.684459 2379 raft_consensus.cc:729] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df0d7ec48b274b69915ce083da47ce9b, State: Initialized, Role: FOLLOWER
I20260809 06:58:00.684999 2379 consensus_queue.cc:260] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } }
I20260809 06:58:00.687426 2379 sys_catalog.cc:564] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:58:00.688054 2352 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:58:00.688216 2353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "df0d7ec48b274b69915ce083da47ce9b"
I20260809 06:58:00.686518 2511 sys_catalog.cc:455] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } } }
I20260809 06:58:00.689172 2511 sys_catalog.cc:458] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:00.692538 2352 raft_consensus.cc:1261] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [term 1 FOLLOWER]: Refusing update from remote peer 7decfaf4b1e945a195aeb2e165e4ca76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:58:00.696030 2353 raft_consensus.cc:2454] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7decfaf4b1e945a195aeb2e165e4ca76 in term 1.
I20260809 06:58:00.699406 2472 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:58:00.726754 2497 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:58:00.736403 2497 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:58:00.765769 2497 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76: Generated new TSK 0
I20260809 06:58:00.767239 2497 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:58:00.775938 2523 sys_catalog.cc:455] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } } }
I20260809 06:58:00.776445 2523 sys_catalog.cc:458] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:00.776871 2510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } } }
I20260809 06:58:00.777273 2510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7decfaf4b1e945a195aeb2e165e4ca76 [sys.catalog]: This master's current role is: LEADER
I20260809 06:58:00.777144 2511 sys_catalog.cc:455] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7decfaf4b1e945a195aeb2e165e4ca76. Latest consensus state: current_term: 1 leader_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7decfaf4b1e945a195aeb2e165e4ca76" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 45007 } } peers { permanent_uuid: "df0d7ec48b274b69915ce083da47ce9b" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 45305 } } peers { permanent_uuid: "0dca7cbac1984321b860fa96990483a7" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 46247 } } }
I20260809 06:58:00.777438 2511 sys_catalog.cc:458] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:00.781867 2528 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260809 06:58:00.847256 2462 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:00.844343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51706 (local address 127.10.205.126:45007)
0809 06:58:00.844568 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.844575 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.845235 (+ 660us) server_negotiation.cc:407] Connection header received
0809 06:58:00.845449 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.845458 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.845559 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.845670 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.846934 (+ 1264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51706: BlockingRecv error: recv got EOF from 127.0.0.1:51706 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 06:58:00.847812 2384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:00.844348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57934 (local address 127.10.205.125:45305)
0809 06:58:00.844569 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.844575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.845975 (+ 1400us) server_negotiation.cc:407] Connection header received
0809 06:58:00.846266 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.846272 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.846367 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.846443 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.847584 (+ 1141us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57934: BlockingRecv error: recv got EOF from 127.0.0.1:57934 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 06:58:00.849772 2465 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:00.846087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45722 (local address 127.10.205.124:46247)
0809 06:58:00.846292 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.846298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.848082 (+ 1784us) server_negotiation.cc:407] Connection header received
0809 06:58:00.848414 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.848421 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.848515 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.848597 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.849554 (+ 957us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45722: BlockingRecv error: recv got EOF from 127.0.0.1:45722 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260809 06:58:00.858304 2384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:00.855044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57938 (local address 127.10.205.125:45305)
0809 06:58:00.855245 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.855251 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.856863 (+ 1612us) server_negotiation.cc:407] Connection header received
0809 06:58:00.857074 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.857079 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.857205 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.857320 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.858026 (+ 706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57938: BlockingRecv error: recv got EOF from 127.0.0.1:57938 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260809 06:58:00.864841 2384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:00.863411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57952 (local address 127.10.205.125:45305)
0809 06:58:00.863594 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.863600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.863620 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:58:00.863687 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.863693 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.863779 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.863888 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.864632 (+ 744us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57952: BlockingRecv error: recv got EOF from 127.0.0.1:57952 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 06:58:00.871764 2384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:00.869738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57960 (local address 127.10.205.125:45305)
0809 06:58:00.869995 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.870003 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.870401 (+ 398us) server_negotiation.cc:407] Connection header received
0809 06:58:00.870582 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.870586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.870650 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.870729 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.871531 (+ 802us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57960: BlockingRecv error: recv got EOF from 127.0.0.1:57960 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260809 06:58:00.881088 2384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:00.879127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57976 (local address 127.10.205.125:45305)
0809 06:58:00.879396 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.879401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.879676 (+ 275us) server_negotiation.cc:407] Connection header received
0809 06:58:00.879858 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.879862 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.879927 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.880008 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.880865 (+ 857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57976: BlockingRecv error: recv got EOF from 127.0.0.1:57976 (error 108)
Metrics: {"server-negotiator.queue_time_us":135}
W20260809 06:58:00.895493 2384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:00.893139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57986 (local address 127.10.205.125:45305)
0809 06:58:00.893341 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.893347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.893900 (+ 553us) server_negotiation.cc:407] Connection header received
0809 06:58:00.894188 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.894199 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.894313 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.894418 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.895269 (+ 851us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57986: BlockingRecv error: recv got EOF from 127.0.0.1:57986 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 06:58:00.917093 2384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:00.914906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57988 (local address 127.10.205.125:45305)
0809 06:58:00.915133 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.915139 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.915582 (+ 443us) server_negotiation.cc:407] Connection header received
0809 06:58:00.915752 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.915758 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.915872 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.915992 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.916834 (+ 842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57988: BlockingRecv error: recv got EOF from 127.0.0.1:57988 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260809 06:58:00.955331 2384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:00.953099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57994 (local address 127.10.205.125:45305)
0809 06:58:00.953345 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:00.953352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:00.953776 (+ 424us) server_negotiation.cc:407] Connection header received
0809 06:58:00.954017 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:00.954030 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:00.954106 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:00.954236 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:00.955026 (+ 790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57994: BlockingRecv error: recv got EOF from 127.0.0.1:57994 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 06:58:01.025149 2384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:01.023014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58006 (local address 127.10.205.125:45305)
0809 06:58:01.023241 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:01.023248 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:01.023602 (+ 354us) server_negotiation.cc:407] Connection header received
0809 06:58:01.023774 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:01.023780 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:01.023917 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:01.024046 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:01.024929 (+ 883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58006: BlockingRecv error: recv got EOF from 127.0.0.1:58006 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260809 06:58:01.160153 2384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:01.158051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58018 (local address 127.10.205.125:45305)
0809 06:58:01.158259 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:01.158265 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:01.158705 (+ 440us) server_negotiation.cc:407] Connection header received
0809 06:58:01.158898 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:01.158902 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:01.159019 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:01.159148 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:01.159897 (+ 749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58018: BlockingRecv error: recv got EOF from 127.0.0.1:58018 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260809 06:58:01.422835 2384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:01.421010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58020 (local address 127.10.205.125:45305)
0809 06:58:01.421235 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:01.421241 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:01.421507 (+ 266us) server_negotiation.cc:407] Connection header received
0809 06:58:01.421670 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:01.421674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:01.421749 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:01.421853 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:01.422659 (+ 806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58020: BlockingRecv error: recv got EOF from 127.0.0.1:58020 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 06:58:01.632459 2500 catalog_manager.cc:1259] Loaded cluster ID: 70448fcdf9c742c0a816e3dc282e419f
I20260809 06:58:01.632596 2500 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7: loading cluster ID for follower catalog manager: success
I20260809 06:58:01.636729 2500 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7: acquiring CA information for follower catalog manager: success
I20260809 06:58:01.639331 2500 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0dca7cbac1984321b860fa96990483a7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:58:01.791743 2528 catalog_manager.cc:1259] Loaded cluster ID: 70448fcdf9c742c0a816e3dc282e419f
I20260809 06:58:01.791997 2528 catalog_manager.cc:1552] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b: loading cluster ID for follower catalog manager: success
I20260809 06:58:01.796860 2528 catalog_manager.cc:1574] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b: acquiring CA information for follower catalog manager: success
I20260809 06:58:01.799871 2528 catalog_manager.cc:1602] T 00000000000000000000000000000000 P df0d7ec48b274b69915ce083da47ce9b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:58:01.962076 2600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:01.940706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58024 (local address 127.10.205.125:45305)
0809 06:58:01.953094 (+ 12388us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:01.953101 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:01.953924 (+ 823us) server_negotiation.cc:407] Connection header received
0809 06:58:01.954167 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:01.954173 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:01.954426 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:01.954582 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:01.955188 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:01.956528 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:01.958575 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:01.959375 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:01.959520 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:01.960388 (+ 868us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:01.961258 (+ 870us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:01.961438 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:01.961563 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 06:58:01.961681 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12203,"thread_start_us":12384,"threads_started":1}
I20260809 06:58:01.991834 2605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:01.976342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45732 (local address 127.10.205.124:46247)
0809 06:58:01.983913 (+ 7571us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:01.983920 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:01.983948 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:58:01.984085 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:01.984093 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:01.984365 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:01.984566 (+ 201us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:01.985165 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:01.986521 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:01.988628 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:01.989376 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:01.989508 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:01.990203 (+ 695us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:01.990989 (+ 786us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:01.991140 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:01.991299 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 06:58:01.991389 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7419,"thread_start_us":7254,"threads_started":1}
I20260809 06:58:02.036365 2600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:02.006424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58034 (local address 127.10.205.125:45305)
0809 06:58:02.006714 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:02.006720 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:02.028978 (+ 22258us) server_negotiation.cc:407] Connection header received
0809 06:58:02.029523 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:02.029530 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:02.029636 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:02.029700 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:02.030458 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:02.031663 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:02.033764 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:02.034459 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:02.034575 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:02.035306 (+ 731us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:02.035453 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:02.035517 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:02.035840 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 06:58:02.035948 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260809 06:58:02.043421 2605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:02.021364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45748 (local address 127.10.205.124:46247)
0809 06:58:02.021578 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:02.021584 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:02.036161 (+ 14577us) server_negotiation.cc:407] Connection header received
0809 06:58:02.036815 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:02.036821 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:02.036911 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:02.036975 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:02.037738 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:02.038897 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:02.041112 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:02.041763 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:02.041858 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:02.042458 (+ 600us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:02.042581 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:02.042673 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:02.042926 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 06:58:02.043049 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:58:02.043668 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:02.006868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51722 (local address 127.10.205.126:45007)
0809 06:58:02.033489 (+ 26621us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:02.033495 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:02.033516 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:58:02.033630 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:02.033636 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:02.033854 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:02.034054 (+ 200us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:02.034856 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:02.036591 (+ 1735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:02.040375 (+ 3784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:02.041043 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:02.041670 (+ 627us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:02.041893 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:02.042391 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:02.043128 (+ 737us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:02.043180 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 06:58:02.043269 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26481,"thread_start_us":27248,"threads_started":1}
I20260809 06:58:02.049444 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 2228
I20260809 06:58:02.051223 2297 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:58:02.165377 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 2228
W20260809 06:58:02.202404 2405 connection.cc:535] server connection from 127.0.0.1:45198 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 06:58:02.202543 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 2310
I20260809 06:58:02.203989 2373 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:58:02.322742 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 2310
I20260809 06:58:02.346599 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 2387
I20260809 06:58:02.347772 2453 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:58:02.454196 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 2387
2026-08-09T06:58:02Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5064 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:58:02 dist-test-slave-0b58 krb5kdc[2620](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:58:02 dist-test-slave-0b58 krb5kdc[2620](info): set up 2 sockets
Aug 09 06:58:02 dist-test-slave-0b58 krb5kdc[2620](info): commencing operation
krb5kdc: starting...
W20260809 06:58:03.623116 11061 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/test-user.keytab.
Aug 09 06:58:03 dist-test-slave-0b58 krb5kdc[2620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:58:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:58:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.205.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
Entry for principal kudu/127.10.205.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab.
I20260809 06:58:03.955498 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:33501
--webserver_interface=127.10.205.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:33501,127.10.205.125:43719,127.10.205.124:42303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:58:04.303201 2633 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 06:58:04.303576 2633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:58:04.303700 2633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:58:04.303831 2633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:58:04.311229 2633 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:58:04.311321 2633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:58:04.311378 2633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:58:04.311421 2633 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:58:04.311547 2633 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:58:04.321650 2633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:33501,127.10.205.125:43719,127.10.205.124:42303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.126.keytab
--principal=kudu/127.10.205.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.126:33501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.205.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:58:04.322991 2633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:58:04.324373 2633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:58:04.336539 2638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:58:04.336618 2639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:58:04.336618 2641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:58:04.337306 2633 server_base.cc:1034] running on GCE node
I20260809 06:58:04.338130 2633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:58:04.339488 2633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:58:04.340725 2633 hybrid_clock.cc:648] HybridClock initialized: now 1786258684340652 us; error 38 us; skew 500 ppm
I20260809 06:58:04.341077 2633 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:58:04 dist-test-slave-0b58 krb5kdc[2620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258684, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:58:04.344247 2633 init.cc:377] Logged in from keytab as kudu/127.10.205.126@KRBTEST.COM (short username kudu)
I20260809 06:58:04.345732 2633 webserver.cc:460] Webserver started at http://127.10.205.126:44845/ using document root <none> and password file <none>
I20260809 06:58:04.346472 2633 fs_manager.cc:359] Metadata directory not provided
I20260809 06:58:04.346621 2633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:58:04.346961 2633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:58:04.349994 2633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/data/instance:
uuid: "2d16c05c8a604dcfa2e5b3a76afa7866"
format_stamp: "Formatted at 2026-08-09 06:58:04 on dist-test-slave-0b58"
server_key: "a96cb942ec67121ef0fa47c0e67904b1"
server_key_iv: "58f22e07637f8b26d16e64b69f5df8f0"
server_key_version: "encryptionkey@0"
I20260809 06:58:04.350838 2633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/wal/instance:
uuid: "2d16c05c8a604dcfa2e5b3a76afa7866"
format_stamp: "Formatted at 2026-08-09 06:58:04 on dist-test-slave-0b58"
server_key: "a96cb942ec67121ef0fa47c0e67904b1"
server_key_iv: "58f22e07637f8b26d16e64b69f5df8f0"
server_key_version: "encryptionkey@0"
I20260809 06:58:04.355952 2633 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 06:58:04.359273 2648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:58:04.360541 2633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260809 06:58:04.360729 2633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/wal
uuid: "2d16c05c8a604dcfa2e5b3a76afa7866"
format_stamp: "Formatted at 2026-08-09 06:58:04 on dist-test-slave-0b58"
server_key: "a96cb942ec67121ef0fa47c0e67904b1"
server_key_iv: "58f22e07637f8b26d16e64b69f5df8f0"
server_key_version: "encryptionkey@0"
I20260809 06:58:04.360950 2633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:58:04.381990 2633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:58:04.386737 2633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:58:04.387046 2633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:58:04.406679 2633 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.126:33501
I20260809 06:58:04.406716 2700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.126:33501 every 8 connection(s)
I20260809 06:58:04.408154 2633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/data/info.pb
I20260809 06:58:04.409152 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 2633
I20260809 06:58:04.409355 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-0/wal/instance
I20260809 06:58:04.409909 11061 external_mini_cluster.cc:1428] Setting key 83469368c64d3834dad06deacc532e9b
I20260809 06:58:04.412871 2701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:58:04.422959 2701 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:58:04 dist-test-slave-0b58 krb5kdc[2620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258684, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.205.125@KRBTEST.COM; defaulting to no policy
I20260809 06:58:04.448923 2705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.426816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55430 (local address 127.10.205.126:33501)
0809 06:58:04.428661 (+ 1845us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:04.428672 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:04.428729 (+ 57us) server_negotiation.cc:407] Connection header received
0809 06:58:04.430022 (+ 1293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:04.430032 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:04.430360 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:04.430576 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:04.432166 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:04.434239 (+ 2073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:04.435653 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:04.436720 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:04.436937 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:04.440345 (+ 3408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:04.440358 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:04.440377 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:04.440420 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:04.444611 (+ 4191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:04.445304 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:04.445314 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:04.445318 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:04.445531 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:04.445914 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:04.445921 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:04.445925 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:04.446708 (+ 783us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:04.446913 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:04.447468 (+ 555us) server_negotiation.cc:299] Negotiation successful
0809 06:58:04.447848 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":144,"server-negotiator.queue_time_us":1579,"thread_start_us":454,"threads_started":1}
I20260809 06:58:04.448987 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.426817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:33501 (local address 127.0.0.1:55430)
0809 06:58:04.427733 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.427780 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:04.429645 (+ 1865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:04.430670 (+ 1025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:04.430680 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:04.431590 (+ 910us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:04.431931 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:04.431949 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:04.434403 (+ 2454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:04.434407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:04.435501 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:04.435514 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:04.436956 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:04.436961 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:04.437116 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:04.437846 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:04.437868 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:04.440049 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:04.444745 (+ 4696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:04.444755 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:04.444764 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:04.445164 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:04.445648 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:04.445651 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:04.445653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:04.445801 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:04.446858 (+ 1057us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:04.446864 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:04.447047 (+ 183us) client_negotiation.cc:769] Sending connection context
0809 06:58:04.447253 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 06:58:04.447667 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"mutex_wait_us":3,"thread_start_us":410,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.125@KRBTEST.COM" created.
I20260809 06:58:04.452070 2701 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:58:04.453392 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.452872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50748)
0809 06:58:04.453073 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.453227 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260809 06:58:04.453671 2649 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
I20260809 06:58:04.455250 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.454830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50760)
0809 06:58:04.454998 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.455086 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 06:58:04.455451 2701 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:43719: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.125.keytab.
Entry for principal kudu/127.10.205.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.125.keytab.
I20260809 06:58:04.489167 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.125:43719
--webserver_interface=127.10.205.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.125.keytab
--principal=kudu/127.10.205.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:33501,127.10.205.125:43719,127.10.205.124:42303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:58:04.504788 2701 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } attempt: 1
I20260809 06:58:04.506047 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.505568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50770)
0809 06:58:04.505771 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.505906 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 06:58:04.507053 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.506711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50776)
0809 06:58:04.506858 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.506933 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 06:58:04.507232 2701 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:43719: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
I20260809 06:58:04.575510 2701 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } attempt: 2
I20260809 06:58:04.576923 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.576424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50790)
0809 06:58:04.576670 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.576764 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 06:58:04.578048 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.577614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50800)
0809 06:58:04.577809 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.577895 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 06:58:04.578233 2701 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:43719: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
I20260809 06:58:04.669596 2701 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } attempt: 3
I20260809 06:58:04.670823 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.670387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50810)
0809 06:58:04.670593 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.670688 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 06:58:04.671828 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.671485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50822)
0809 06:58:04.671626 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.671701 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 06:58:04.672027 2701 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:43719: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
I20260809 06:58:04.815267 2701 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } attempt: 4
I20260809 06:58:04.816504 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.815905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50838)
0809 06:58:04.816218 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.816365 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
I20260809 06:58:04.817510 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.817148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50846)
0809 06:58:04.817293 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.817384 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 06:58:04.817678 2701 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.125:43719: Network error: Client connection negotiation failed: client connection to 127.10.205.125:43719: connect: Connection refused (error 111)
W20260809 06:58:04.830147 2708 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 06:58:04.830511 2708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:58:04.830629 2708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:58:04.830783 2708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:58:04.838685 2708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:58:04.838819 2708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:58:04.838919 2708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:58:04.839013 2708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:58:04.839102 2708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:58:04.849812 2708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:33501,127.10.205.125:43719,127.10.205.124:42303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.125.keytab
--principal=kudu/127.10.205.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.125:43719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.205.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:58:04.851195 2708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:58:04.852662 2708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:58:04.865029 2715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:58:04.865346 2717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:58:04.865029 2713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:58:04.865947 2708 server_base.cc:1034] running on GCE node
I20260809 06:58:04.866706 2708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:58:04.868024 2708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:58:04.869280 2708 hybrid_clock.cc:648] HybridClock initialized: now 1786258684869189 us; error 65 us; skew 500 ppm
I20260809 06:58:04.869599 2708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:58:04 dist-test-slave-0b58 krb5kdc[2620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258684, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:58:04.872684 2708 init.cc:377] Logged in from keytab as kudu/127.10.205.125@KRBTEST.COM (short username kudu)
I20260809 06:58:04.874061 2708 webserver.cc:460] Webserver started at http://127.10.205.125:38071/ using document root <none> and password file <none>
I20260809 06:58:04.874778 2708 fs_manager.cc:359] Metadata directory not provided
I20260809 06:58:04.874917 2708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:58:04.875236 2708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:58:04.878223 2708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/data/instance:
uuid: "11efcbe30ba7437ea05a99061ee45377"
format_stamp: "Formatted at 2026-08-09 06:58:04 on dist-test-slave-0b58"
server_key: "e1ecc8e57747664700ba48457ac81b15"
server_key_iv: "31e0d8f3c3a7e3b8d102753c702e6173"
server_key_version: "encryptionkey@0"
I20260809 06:58:04.879170 2708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/wal/instance:
uuid: "11efcbe30ba7437ea05a99061ee45377"
format_stamp: "Formatted at 2026-08-09 06:58:04 on dist-test-slave-0b58"
server_key: "e1ecc8e57747664700ba48457ac81b15"
server_key_iv: "31e0d8f3c3a7e3b8d102753c702e6173"
server_key_version: "encryptionkey@0"
I20260809 06:58:04.884186 2708 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 06:58:04.887531 2724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:58:04.888909 2708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 06:58:04.889081 2708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/wal
uuid: "11efcbe30ba7437ea05a99061ee45377"
format_stamp: "Formatted at 2026-08-09 06:58:04 on dist-test-slave-0b58"
server_key: "e1ecc8e57747664700ba48457ac81b15"
server_key_iv: "31e0d8f3c3a7e3b8d102753c702e6173"
server_key_version: "encryptionkey@0"
I20260809 06:58:04.889310 2708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:58:04.907714 2708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:58:04.911475 2708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:58:04.911751 2708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:58:04.930197 2708 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.125:43719
I20260809 06:58:04.930217 2777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.125:43719 every 8 connection(s)
I20260809 06:58:04.931735 2708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/data/info.pb
I20260809 06:58:04.934377 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 2708
I20260809 06:58:04.934605 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-1/wal/instance
I20260809 06:58:04.935160 11061 external_mini_cluster.cc:1428] Setting key cbc6e2cf5d6d4c6d2a90626f50e2313f
I20260809 06:58:04.935920 2778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:58:04.945716 2778 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:58:04 dist-test-slave-0b58 krb5kdc[2620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258684, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.125@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:58:04.968802 2705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.949105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55440 (local address 127.10.205.126:33501)
0809 06:58:04.949330 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:04.949337 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:04.950620 (+ 1283us) server_negotiation.cc:407] Connection header received
0809 06:58:04.952581 (+ 1961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:04.952585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:04.952653 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:04.952732 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:04.954743 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:04.955405 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:04.957806 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:04.958195 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:04.958294 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:04.962597 (+ 4303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:04.962602 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:04.962605 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:04.962640 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:04.965596 (+ 2956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:04.966362 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:04.966367 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:04.966371 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:04.966499 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:04.966936 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:04.966941 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:04.966950 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:04.967228 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:04.967409 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:04.968379 (+ 970us) server_negotiation.cc:299] Negotiation successful
0809 06:58:04.968558 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 06:58:04.970393 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.949627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:33501 (local address 127.0.0.1:55440)
0809 06:58:04.950447 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.950493 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:04.952229 (+ 1736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:04.952993 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:04.953006 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:04.953789 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:04.954567 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:04.954593 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:04.955565 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:04.955573 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:04.957657 (+ 2084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:04.957675 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:04.958421 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:04.958430 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:04.958767 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:04.959521 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:04.959555 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:04.962343 (+ 2788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:04.965729 (+ 3386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:04.965739 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:04.965756 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:04.966227 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:04.966614 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:04.966619 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:04.966623 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:04.966812 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:04.967390 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:04.967397 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:04.967847 (+ 450us) client_negotiation.cc:769] Sending connection context
0809 06:58:04.968202 (+ 355us) client_negotiation.cc:240] Negotiation successful
0809 06:58:04.968868 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":358,"threads_started":1}
WARNING: no policy specified for kudu/127.10.205.124@KRBTEST.COM; defaulting to no policy
I20260809 06:58:04.972242 2778 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.205.124@KRBTEST.COM" created.
Aug 09 06:58:04 dist-test-slave-0b58 krb5kdc[2620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258684, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.125@KRBTEST.COM for kudu/127.10.205.125@KRBTEST.COM
I20260809 06:58:04.987891 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.973067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50852)
0809 06:58:04.973249 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.973271 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:04.973381 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:04.974800 (+ 1419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:04.974803 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:04.975135 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:04.975260 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:04.975267 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:04.976701 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:04.976709 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:04.977535 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:04.977546 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:04.978361 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:04.978367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:04.978573 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:04.979164 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:04.979181 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:04.981265 (+ 2084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:04.985553 (+ 4288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:04.985557 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:04.985560 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:04.985922 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:04.986350 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:04.986353 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:04.986355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:04.986489 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:04.987194 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:04.987197 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:04.987304 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 06:58:04.987425 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 06:58:04.987631 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 06:58:04.988428 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.973393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50852 (local address 127.10.205.125:43719)
0809 06:58:04.974098 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:04.974104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:04.974128 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:58:04.974169 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:04.974175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:04.974431 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:04.974602 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:04.975452 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:04.976575 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:04.977673 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:04.978192 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:04.978344 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:04.981495 (+ 3151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:04.981510 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:04.981529 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:04.981567 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:04.985413 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:04.986051 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:04.986062 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:04.986068 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:04.986228 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:04.986591 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:04.986599 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:04.986605 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:04.987077 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:04.987303 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:04.987616 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 06:58:04.987903 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":406,"threads_started":1}
I20260809 06:58:04.991008 2778 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:58:04.992375 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.991768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38438)
0809 06:58:04.991982 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.992126 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 06:58:04.992671 2729 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
I20260809 06:58:04.994345 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:04.993907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38452)
0809 06:58:04.994091 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:04.994196 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 06:58:04.994613 2778 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:42303: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.205.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.124.keytab.
Entry for principal kudu/127.10.205.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.124.keytab.
I20260809 06:58:05.015458 11061 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
/tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.124:42303
--webserver_interface=127.10.205.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.124.keytab
--principal=kudu/127.10.205.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.205.84:46243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.205.126:33501,127.10.205.125:43719,127.10.205.124:42303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:58:05.043992 2778 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } attempt: 1
I20260809 06:58:05.045506 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.044838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38458)
0809 06:58:05.045128 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.045275 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260809 06:58:05.046666 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.046205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38462)
0809 06:58:05.046406 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.046510 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 06:58:05.046888 2778 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:42303: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
I20260809 06:58:05.115165 2778 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } attempt: 2
I20260809 06:58:05.116557 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.115919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38466)
0809 06:58:05.116195 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.116348 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260809 06:58:05.116901 2701 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } attempt: 5
I20260809 06:58:05.117725 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.117326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38480)
0809 06:58:05.117491 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.117575 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 06:58:05.117942 2778 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:42303: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Aug 09 06:58:05 dist-test-slave-0b58 krb5kdc[2620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258684, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for kudu/127.10.205.125@KRBTEST.COM
I20260809 06:58:05.131660 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.117670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50866 (local address 127.10.205.125:43719)
0809 06:58:05.117838 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.117845 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:05.117996 (+ 151us) server_negotiation.cc:407] Connection header received
0809 06:58:05.118199 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:05.118202 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:05.118286 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:05.118367 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:05.119417 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.120146 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.121839 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.122284 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.122378 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.126146 (+ 3768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:05.126151 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:05.126155 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:05.126206 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:05.128990 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.129686 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.129692 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.129696 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.129830 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.130242 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.130248 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.130252 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.130535 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:05.130690 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:05.131072 (+ 382us) server_negotiation.cc:299] Negotiation successful
0809 06:58:05.131286 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:58:05.131670 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.117553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50866)
0809 06:58:05.117897 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.117918 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:05.118055 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:05.118449 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:05.118458 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:05.118998 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:05.119251 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:05.119270 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.120321 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.120329 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:05.121687 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:05.121704 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.122459 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.122466 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:05.122716 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.123392 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:05.123416 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:05.125938 (+ 2522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:05.129146 (+ 3208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:05.129152 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:05.129156 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:05.129558 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:05.129950 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:05.129955 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:05.129958 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:05.130125 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:05.130657 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:05.130662 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:05.130824 (+ 162us) client_negotiation.cc:769] Sending connection context
0809 06:58:05.130972 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 06:58:05.131283 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210}
I20260809 06:58:05.132917 2701 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:58:05.134169 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.133796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38484)
0809 06:58:05.133963 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.134041 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 06:58:05.135135 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.134792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38494)
0809 06:58:05.134955 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.135029 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 06:58:05.135362 2701 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:42303: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
I20260809 06:58:05.186589 2701 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } attempt: 1
I20260809 06:58:05.187886 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.187428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38506)
0809 06:58:05.187630 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.187721 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 06:58:05.188956 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.188629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38514)
0809 06:58:05.188776 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.188854 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 06:58:05.189180 2701 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:42303: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
I20260809 06:58:05.209158 2778 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } attempt: 3
I20260809 06:58:05.210434 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.209876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38520)
0809 06:58:05.210094 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.210230 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 06:58:05.211594 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.211155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38522)
0809 06:58:05.211413 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.211492 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
W20260809 06:58:05.211800 2778 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:42303: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
I20260809 06:58:05.257375 2701 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } attempt: 2
I20260809 06:58:05.258669 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.258170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38530)
0809 06:58:05.258394 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.258487 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 06:58:05.259727 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.259405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38542)
0809 06:58:05.259560 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.259624 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 06:58:05.259932 2701 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:42303: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
I20260809 06:58:05.354983 2778 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } attempt: 4
I20260809 06:58:05.356096 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.355601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38548)
0809 06:58:05.355868 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.355947 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 06:58:05.357065 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.356773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38556)
0809 06:58:05.356912 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.356972 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 06:58:05.357292 2778 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:42303: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
W20260809 06:58:05.359454 2786 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 06:58:05.359792 2786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:58:05.359898 2786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:58:05.360036 2786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 06:58:05.366134 2701 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } attempt: 3
I20260809 06:58:05.367246 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.366797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38564)
0809 06:58:05.367009 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.367088 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 06:58:05.367391 2786 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:58:05.367514 2786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:58:05.367620 2786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:58:05.367697 2786 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:58:05.367781 2786 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:58:05.368425 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.368018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38568)
0809 06:58:05.368198 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.368326 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260809 06:58:05.368641 2701 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.205.124:42303: Network error: Client connection negotiation failed: client connection to 127.10.205.124:42303: connect: Connection refused (error 111)
I20260809 06:58:05.377673 2786 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.205.84:46243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.205.126:33501,127.10.205.125:43719,127.10.205.124:42303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/krb5kdc/kudu_127.10.205.124.keytab
--principal=kudu/127.10.205.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.205.124:42303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.205.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:54:04 UTC on ccycloud.quasar-xkgyaq.root.comops.site
build id 4575853
ASAN enabled
I20260809 06:58:05.378989 2786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:58:05.380569 2786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:58:05.391904 2791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:58:05.392114 2794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:58:05.392141 2792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:58:05.392980 2786 server_base.cc:1034] running on GCE node
I20260809 06:58:05.393832 2786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:58:05.395117 2786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:58:05.396360 2786 hybrid_clock.cc:648] HybridClock initialized: now 1786258685396284 us; error 49 us; skew 500 ppm
I20260809 06:58:05.396677 2786 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:58:05 dist-test-slave-0b58 krb5kdc[2620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258685, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:58:05.399777 2786 init.cc:377] Logged in from keytab as kudu/127.10.205.124@KRBTEST.COM (short username kudu)
I20260809 06:58:05.401172 2786 webserver.cc:460] Webserver started at http://127.10.205.124:34159/ using document root <none> and password file <none>
I20260809 06:58:05.401816 2786 fs_manager.cc:359] Metadata directory not provided
I20260809 06:58:05.401901 2786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:58:05.402160 2786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:58:05.405121 2786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/data/instance:
uuid: "8083019ab23643fc97ffbca85c0abbb5"
format_stamp: "Formatted at 2026-08-09 06:58:05 on dist-test-slave-0b58"
server_key: "4bf7f23e84fd80dbaf861dea93d68e9f"
server_key_iv: "cfd8b60c445ff4490e216a5e47c93b03"
server_key_version: "encryptionkey@0"
I20260809 06:58:05.405853 2786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/wal/instance:
uuid: "8083019ab23643fc97ffbca85c0abbb5"
format_stamp: "Formatted at 2026-08-09 06:58:05 on dist-test-slave-0b58"
server_key: "4bf7f23e84fd80dbaf861dea93d68e9f"
server_key_iv: "cfd8b60c445ff4490e216a5e47c93b03"
server_key_version: "encryptionkey@0"
I20260809 06:58:05.410988 2786 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:58:05.414361 2801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:58:05.415592 2786 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:58:05.415779 2786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/data,/tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/wal
uuid: "8083019ab23643fc97ffbca85c0abbb5"
format_stamp: "Formatted at 2026-08-09 06:58:05 on dist-test-slave-0b58"
server_key: "4bf7f23e84fd80dbaf861dea93d68e9f"
server_key_iv: "cfd8b60c445ff4490e216a5e47c93b03"
server_key_version: "encryptionkey@0"
I20260809 06:58:05.415993 2786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:58:05.432201 2786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:58:05.436713 2786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:58:05.437016 2786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:58:05.455500 2786 rpc_server.cc:307] RPC server started. Bound to: 127.10.205.124:42303
I20260809 06:58:05.455520 2852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.205.124:42303 every 8 connection(s)
I20260809 06:58:05.456904 2786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/data/info.pb
I20260809 06:58:05.459286 11061 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu as pid 2786
I20260809 06:58:05.459482 11061 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskDfk6Nc/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786258311159624-11061-0/minicluster-data/master-2/wal/instance
I20260809 06:58:05.460024 11061 external_mini_cluster.cc:1428] Setting key 61ddd814aed7aaf185ac37c0b9fca4b5
I20260809 06:58:05.461194 2853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:58:05.470511 2853 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:58:05 dist-test-slave-0b58 krb5kdc[2620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.124@KRBTEST.COM
Aug 09 06:58:05 dist-test-slave-0b58 krb5kdc[2620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258685, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.124@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
I20260809 06:58:05.483629 2856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.461814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38570 (local address 127.10.205.124:42303)
0809 06:58:05.462553 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.462564 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:05.462616 (+ 52us) server_negotiation.cc:407] Connection header received
0809 06:58:05.464127 (+ 1511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:05.464145 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:05.464600 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:05.465047 (+ 447us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:05.466876 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.468190 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.469930 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.470561 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.470682 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.475494 (+ 4812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:05.475504 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:05.475515 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:05.475567 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:05.479367 (+ 3800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.480183 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.480191 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.480199 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.480452 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.480898 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.480903 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.480908 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.481456 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:05.481814 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:05.482219 (+ 405us) server_negotiation.cc:299] Negotiation successful
0809 06:58:05.482595 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":342,"threads_started":1}
I20260809 06:58:05.489967 2857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.473443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55456 (local address 127.10.205.126:33501)
0809 06:58:05.473993 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.474002 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:05.474477 (+ 475us) server_negotiation.cc:407] Connection header received
0809 06:58:05.474673 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:05.474680 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:05.474776 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:05.474917 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:05.476423 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.477276 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.479434 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.480091 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.480207 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.483497 (+ 3290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:05.483501 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:05.483504 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:05.483535 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:05.486873 (+ 3338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.487762 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.487767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.487770 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.487998 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.488435 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.488443 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.488447 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.488811 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:05.488973 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:05.489443 (+ 470us) server_negotiation.cc:299] Negotiation successful
0809 06:58:05.489631 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":261,"threads_started":1}
I20260809 06:58:05.490072 2858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.473447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.126:33501 (local address 127.0.0.1:55456)
0809 06:58:05.474327 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.474376 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:05.474525 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:05.474988 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:05.474994 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:05.475833 (+ 839us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:05.476218 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:05.476235 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.477459 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.477477 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:05.479271 (+ 1794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:05.479288 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.480303 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.480312 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:05.480531 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.481168 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:05.481184 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:05.483297 (+ 2113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:05.487010 (+ 3713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:05.487024 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:05.487034 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:05.487610 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:05.488124 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:05.488127 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:05.488129 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:05.488306 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:05.488946 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:05.488951 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:05.489106 (+ 155us) client_negotiation.cc:769] Sending connection context
0809 06:58:05.489292 (+ 186us) client_negotiation.cc:240] Negotiation successful
0809 06:58:05.489649 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":509,"threads_started":1}
I20260809 06:58:05.491501 2853 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:58:05 dist-test-slave-0b58 krb5kdc[2620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.126@KRBTEST.COM
Aug 09 06:58:05 dist-test-slave-0b58 krb5kdc[2620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258685, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.124@KRBTEST.COM for kudu/127.10.205.125@KRBTEST.COM
I20260809 06:58:05.503822 2859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.486831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55472 (local address 127.10.205.126:33501)
0809 06:58:05.487496 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.487503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:05.487527 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:58:05.487576 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:05.487580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:05.487649 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:05.487783 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:05.489361 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.490648 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.492240 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.492872 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.493004 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.497481 (+ 4477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:05.497486 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:05.497489 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:05.497516 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:05.500772 (+ 3256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.501553 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.501557 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.501559 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.501674 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.502073 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.502076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.502083 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.502368 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:05.502741 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:05.503067 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 06:58:05.503350 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":272,"threads_started":1}
I20260809 06:58:05.505679 2858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.492117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.125:43719 (local address 127.0.0.1:50880)
0809 06:58:05.492324 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.492343 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:05.492421 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:05.492741 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:05.492746 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:05.493207 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:05.493343 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:05.493352 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.494299 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.494306 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:05.495171 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:05.495182 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.496062 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.496067 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:05.496193 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.496723 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:05.496748 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:05.499009 (+ 2261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:05.502476 (+ 3467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:05.502483 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:05.502487 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:05.503116 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:05.503638 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:05.503648 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:05.503652 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:05.503827 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:05.504827 (+ 1000us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:05.504837 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:05.505023 (+ 186us) client_negotiation.cc:769] Sending connection context
0809 06:58:05.505152 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 06:58:05.505346 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 06:58:05.506031 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.492306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50880 (local address 127.10.205.125:43719)
0809 06:58:05.492490 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.492494 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:05.492508 (+ 14us) server_negotiation.cc:407] Connection header received
0809 06:58:05.492555 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:05.492559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:05.492613 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:05.492686 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:05.493500 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.494168 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.495315 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.495904 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.496044 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.499206 (+ 3162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:05.499211 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:05.499214 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:05.499244 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:05.502325 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.503273 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.503279 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.503283 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.503487 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.504194 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.504198 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.504200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.504658 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:05.504878 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:05.505261 (+ 383us) server_negotiation.cc:299] Negotiation successful
0809 06:58:05.505494 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:58:05.507369 2853 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:58:05 dist-test-slave-0b58 krb5kdc[2620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.205.125@KRBTEST.COM
Aug 09 06:58:05 dist-test-slave-0b58 krb5kdc[2620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258685, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.124@KRBTEST.COM for kudu/127.10.205.124@KRBTEST.COM
I20260809 06:58:05.521461 2858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.508192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38574)
0809 06:58:05.508372 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.508390 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:05.508477 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:05.508889 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:05.508892 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:05.509197 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:05.509317 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:05.509324 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.510211 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.510219 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:05.511047 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:05.511057 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.511934 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.511940 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:05.512134 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.512742 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:05.512764 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:05.515040 (+ 2276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:05.518294 (+ 3254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:05.518305 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:05.518308 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:05.518749 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:05.519231 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:05.519235 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:05.519239 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:05.519472 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:05.520113 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:05.520122 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:05.520397 (+ 275us) client_negotiation.cc:769] Sending connection context
0809 06:58:05.520594 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 06:58:05.520987 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 06:58:05.522166 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.505820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50892 (local address 127.10.205.125:43719)
0809 06:58:05.506329 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.506336 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:05.506361 (+ 25us) server_negotiation.cc:407] Connection header received
0809 06:58:05.506459 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:05.506470 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:05.506560 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:05.506734 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:05.508122 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.509128 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.510326 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.510714 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.510852 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.515107 (+ 4255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:05.515111 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:05.515114 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:05.515143 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:05.517893 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.518755 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.518773 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.518781 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.518956 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.519485 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.519489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.519491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.519921 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:05.520335 (+ 414us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:05.521441 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0809 06:58:05.521725 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":684,"threads_started":1}
I20260809 06:58:05.522475 2856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.508437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38574 (local address 127.10.205.124:42303)
0809 06:58:05.508621 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.508627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:05.508645 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:58:05.508694 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:05.508699 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:05.508763 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:05.508857 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:05.509447 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.510094 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.511210 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.511772 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.511921 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.515208 (+ 3287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:05.515213 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:05.515216 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:05.515242 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:05.518108 (+ 2866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.518913 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.518921 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.518924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.519079 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.519591 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.519596 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.519599 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.519981 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:05.520157 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:05.521797 (+ 1640us) server_negotiation.cc:299] Negotiation successful
0809 06:58:05.522063 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:58:05.528175 11061 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:58:05.529067 2853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5: Bootstrap starting.
I20260809 06:58:05.533494 2853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5: Neither blocks nor log segments found. Creating new log.
I20260809 06:58:05.534795 2853 log.cc:824] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5: Log is configured to *not* fsync() on all Append() calls
I20260809 06:58:05.531363 2676 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55472
I20260809 06:58:05.537943 2853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5: No bootstrap required, opened a new log
I20260809 06:58:05.545841 2701 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } attempt: 4
I20260809 06:58:05.548776 2853 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } }
I20260809 06:58:05.549132 2853 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8083019ab23643fc97ffbca85c0abbb5, State: Initialized, Role: FOLLOWER
I20260809 06:58:05.549674 2853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } }
I20260809 06:58:05.550603 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } } }
I20260809 06:58:05.550932 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:05.551959 2853 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [sys.catalog]: configured and running, proceeding with master startup.
Aug 09 06:58:05 dist-test-slave-0b58 krb5kdc[2620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258684, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.126@KRBTEST.COM for kudu/127.10.205.124@KRBTEST.COM
I20260809 06:58:05.563746 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.546589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38588)
0809 06:58:05.546817 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.546847 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:05.546987 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:05.547483 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:05.547488 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:05.548018 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:05.548239 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:05.548280 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.549569 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.549574 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:05.551050 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:05.551065 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.551758 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.551763 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:05.551962 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.552643 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:05.552667 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:05.555880 (+ 3213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:05.560314 (+ 4434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:05.560322 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:05.560328 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:05.561033 (+ 705us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:05.561545 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:05.561553 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:05.561559 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:05.561769 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:05.562621 (+ 852us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:05.562626 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:05.562815 (+ 189us) client_negotiation.cc:769] Sending connection context
0809 06:58:05.562985 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 06:58:05.563287 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 06:58:05.564375 2856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.546636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38588 (local address 127.10.205.124:42303)
0809 06:58:05.546840 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.546845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:05.546911 (+ 66us) server_negotiation.cc:407] Connection header received
0809 06:58:05.547132 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:05.547138 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:05.547232 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:05.547355 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:05.548428 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.549458 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.551183 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.551611 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.551698 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.556118 (+ 4420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:05.556127 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:05.556133 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:05.556178 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:05.560131 (+ 3953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.561232 (+ 1101us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.561238 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.561242 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.561418 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.561934 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.561942 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.561945 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.562394 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:05.562545 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:05.563412 (+ 867us) server_negotiation.cc:299] Negotiation successful
0809 06:58:05.563963 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:58:05.570600 2701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866: Bootstrap starting.
I20260809 06:58:05.559839 2786 master_runner.cc:186] Error getting master registration for 127.10.205.126:33501: OK, instance_id { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" instance_seqno: 1786258684401086 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 06:58:05.571519 2786 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 06:58:05.574630 2874 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260809 06:58:05.574710 2701 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866: Neither blocks nor log segments found. Creating new log.
W20260809 06:58:05.574769 2874 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:58:05.576022 2701 log.cc:824] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866: Log is configured to *not* fsync() on all Append() calls
I20260809 06:58:05.579664 2701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866: No bootstrap required, opened a new log
I20260809 06:58:05.587715 2701 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } }
I20260809 06:58:05.588160 2701 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d16c05c8a604dcfa2e5b3a76afa7866, State: Initialized, Role: FOLLOWER
I20260809 06:58:05.588708 2701 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } }
I20260809 06:58:05.589728 2877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } } }
I20260809 06:58:05.590173 2877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:05.591012 2701 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:58:05.591042 2676 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 06:58:05.591225 2676 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:58:05.594316 2676 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } }
I20260809 06:58:05.596505 2828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8083019ab23643fc97ffbca85c0abbb5"
I20260809 06:58:05.597043 2828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:58:05.600505 2828 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d16c05c8a604dcfa2e5b3a76afa7866 in term 1.
I20260809 06:58:05.600469 2676 leader_election.cc:288] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [CANDIDATE]: Term 1 election: Requested vote from peers 11efcbe30ba7437ea05a99061ee45377 (127.10.205.125:43719), 8083019ab23643fc97ffbca85c0abbb5 (127.10.205.124:42303)
I20260809 06:58:05.601503 2652 leader_election.cc:302] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d16c05c8a604dcfa2e5b3a76afa7866, 8083019ab23643fc97ffbca85c0abbb5; no voters:
I20260809 06:58:05.602052 2877 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:58:05.615288 2877 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [term 1 LEADER]: Becoming Leader. State: Replica: 2d16c05c8a604dcfa2e5b3a76afa7866, State: Running, Role: LEADER
I20260809 06:58:05.616078 2877 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } }
I20260809 06:58:05.625133 2882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d16c05c8a604dcfa2e5b3a76afa7866. Latest consensus state: current_term: 1 leader_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } } }
I20260809 06:58:05.625631 2882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [sys.catalog]: This master's current role is: LEADER
I20260809 06:58:05.628558 2889 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260809 06:58:05.640045 2654 tablet.cc:2369] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:58:05.644646 2889 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:58:05.656519 2778 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } attempt: 5
I20260809 06:58:05.667385 2899 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
Aug 09 06:58:05 dist-test-slave-0b58 krb5kdc[2620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786258684, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.205.125@KRBTEST.COM for kudu/127.10.205.124@KRBTEST.COM
I20260809 06:58:05.681458 2780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.657215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.205.124:42303 (local address 127.0.0.1:38606)
0809 06:58:05.657636 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0809 06:58:05.657661 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 06:58:05.657799 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:58:05.660358 (+ 2559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:58:05.660365 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:58:05.660915 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:58:05.661139 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:05.661152 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.667730 (+ 6578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.667736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:05.669129 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:58:05.669144 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.670148 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.670154 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:58:05.670427 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.671155 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:58:05.671183 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:58:05.674146 (+ 2963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:58:05.678512 (+ 4366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:05.678519 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:05.678525 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:05.679032 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:05.679518 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:58:05.679525 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:58:05.679531 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:58:05.679738 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:58:05.680406 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:58:05.680414 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:58:05.680579 (+ 165us) client_negotiation.cc:769] Sending connection context
0809 06:58:05.680718 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 06:58:05.681041 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276}
I20260809 06:58:05.682688 2900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.658066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38606 (local address 127.10.205.124:42303)
0809 06:58:05.658828 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.658835 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:05.658860 (+ 25us) server_negotiation.cc:407] Connection header received
0809 06:58:05.658924 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:05.658931 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:05.659032 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:05.661359 (+ 2327us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:05.661650 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.662985 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.669341 (+ 6356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.669966 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.674347 (+ 4381us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.674610 (+ 263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:05.674616 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:05.674621 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:05.674653 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:05.678355 (+ 3702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.679197 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.679203 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.679206 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.679387 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.679895 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.679900 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.679904 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.680237 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:05.681841 (+ 1604us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:05.681960 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 06:58:05.682185 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":390,"threads_started":1}
I20260809 06:58:05.671717 2633 master_runner.cc:186] Error getting master registration for 127.10.205.125:43719: OK, instance_id { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" instance_seqno: 1786258684924821 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 06:58:05.688110 2633 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 06:58:05.689000 2807 tablet.cc:2369] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:58:05.690464 2778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377: Bootstrap starting.
I20260809 06:58:05.692890 2828 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [term 1 FOLLOWER]: Refusing update from remote peer 2d16c05c8a604dcfa2e5b3a76afa7866: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:58:05.693987 2877 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:58:05.697055 2778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377: Neither blocks nor log segments found. Creating new log.
I20260809 06:58:05.698390 2778 log.cc:824] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377: Log is configured to *not* fsync() on all Append() calls
I20260809 06:58:05.725876 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d16c05c8a604dcfa2e5b3a76afa7866. Latest consensus state: current_term: 1 leader_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } } }
I20260809 06:58:05.726243 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:05.726809 2859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.651994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55474 (local address 127.10.205.126:33501)
0809 06:58:05.652191 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.652197 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:05.664157 (+ 11960us) server_negotiation.cc:407] Connection header received
0809 06:58:05.665177 (+ 1020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:05.665183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:05.665280 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:05.665356 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:05.677502 (+ 12146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.678628 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.683036 (+ 4408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.683736 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.683849 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.712453 (+ 28604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:05.712462 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:05.712467 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:05.712517 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:05.716407 (+ 3890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.722356 (+ 5949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.722363 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.722367 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.722531 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.723680 (+ 1149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.723686 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.723689 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.724099 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:05.724363 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:05.726105 (+ 1742us) server_negotiation.cc:299] Negotiation successful
0809 06:58:05.726383 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 06:58:05.740471 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.652309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50894 (local address 127.10.205.125:43719)
0809 06:58:05.652516 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.652523 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:05.665624 (+ 13101us) server_negotiation.cc:407] Connection header received
0809 06:58:05.666359 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:05.666364 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:05.666444 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:05.666513 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:05.671820 (+ 5307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.673062 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.680285 (+ 7223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.680993 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.681101 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.717449 (+ 36348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:05.717457 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:05.717462 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:05.717511 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:05.721358 (+ 3847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.723037 (+ 1679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.723046 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.723049 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.723214 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.724862 (+ 1648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.724867 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.724871 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.725258 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:05.725482 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:05.739725 (+ 14243us) server_negotiation.cc:299] Negotiation successful
0809 06:58:05.740044 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:58:05.740849 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } } }
I20260809 06:58:05.741134 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:05.747617 2877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } } }
I20260809 06:58:05.747975 2877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [sys.catalog]: This master's current role is: LEADER
I20260809 06:58:05.750290 2889 catalog_manager.cc:1347] Generated new cluster ID: 8318622ff00343f1a20bc8565701174c
I20260809 06:58:05.750414 2889 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:58:05.751621 2778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377: No bootstrap required, opened a new log
I20260809 06:58:05.753347 2856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:05.651665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38596 (local address 127.10.205.124:42303)
0809 06:58:05.651967 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.651976 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:05.670640 (+ 18664us) server_negotiation.cc:407] Connection header received
0809 06:58:05.673630 (+ 2990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:05.673636 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:05.673724 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:05.673795 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:05.699661 (+ 25866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.700976 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.708182 (+ 7206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:05.708921 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:05.709023 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:05.743583 (+ 34560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:58:05.743590 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:58:05.743597 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:58:05.743646 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:58:05.747592 (+ 3946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.748583 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.748589 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.748593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.748747 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:58:05.749288 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:58:05.749294 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:58:05.749300 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:58:05.749746 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:58:05.750015 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:05.752746 (+ 2731us) server_negotiation.cc:299] Negotiation successful
0809 06:58:05.752988 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260809 06:58:05.764705 2778 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } }
I20260809 06:58:05.765254 2778 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11efcbe30ba7437ea05a99061ee45377, State: Initialized, Role: FOLLOWER
I20260809 06:58:05.765822 2778 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } }
I20260809 06:58:05.784873 2907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } } }
I20260809 06:58:05.785538 2907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:05.786245 2889 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:58:05.786381 2778 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:58:05.786489 2752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "11efcbe30ba7437ea05a99061ee45377"
I20260809 06:58:05.786988 2752 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:58:05.788108 2889 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:58:05.790407 2752 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d16c05c8a604dcfa2e5b3a76afa7866 in term 1.
I20260809 06:58:05.794188 2751 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [term 1 FOLLOWER]: Refusing update from remote peer 2d16c05c8a604dcfa2e5b3a76afa7866: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:58:05.795145 2882 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:58:05.809140 2889 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866: Generated new TSK 0
I20260809 06:58:05.810223 2889 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:58:05.873955 2882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } } }
I20260809 06:58:05.874300 2882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d16c05c8a604dcfa2e5b3a76afa7866 [sys.catalog]: This master's current role is: LEADER
I20260809 06:58:05.876812 2907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d16c05c8a604dcfa2e5b3a76afa7866. Latest consensus state: current_term: 1 leader_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } } }
I20260809 06:58:05.877116 2907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:05.877969 2920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d16c05c8a604dcfa2e5b3a76afa7866" member_type: VOTER last_known_addr { host: "127.10.205.126" port: 33501 } } peers { permanent_uuid: "11efcbe30ba7437ea05a99061ee45377" member_type: VOTER last_known_addr { host: "127.10.205.125" port: 43719 } } peers { permanent_uuid: "8083019ab23643fc97ffbca85c0abbb5" member_type: VOTER last_known_addr { host: "127.10.205.124" port: 42303 } } }
I20260809 06:58:05.878440 2920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:58:05.899471 2924 catalog_manager.cc:1259] Loaded cluster ID: 8318622ff00343f1a20bc8565701174c
I20260809 06:58:05.899737 2924 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377: loading cluster ID for follower catalog manager: success
I20260809 06:58:05.904148 2924 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377: acquiring CA information for follower catalog manager: success
I20260809 06:58:05.907014 2924 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 11efcbe30ba7437ea05a99061ee45377: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 06:58:05.950639 11061 mini_kdc.cc:348] Time spent kdestroy: real 0.129s user 0.002s sys 0.033s
W20260809 06:58:06.010927 2782 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:05.990690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50902 (local address 127.10.205.125:43719)
0809 06:58:05.990889 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.990895 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.008653 (+ 17758us) server_negotiation.cc:407] Connection header received
0809 06:58:06.009362 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.009369 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.009453 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.009536 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:06.010679 (+ 1143us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50902: BlockingRecv error: recv got EOF from 127.0.0.1:50902 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 06:58:06.013213 2859 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:05.984048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55480 (local address 127.10.205.126:33501)
0809 06:58:05.984241 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:05.984248 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.008111 (+ 23863us) server_negotiation.cc:407] Connection header received
0809 06:58:06.011502 (+ 3391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.011508 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.011596 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.011665 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:06.012928 (+ 1263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55480: BlockingRecv error: recv got EOF from 127.0.0.1:55480 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 06:58:06.016091 2856 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:06.005393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38616 (local address 127.10.205.124:42303)
0809 06:58:06.005577 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.005583 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.014145 (+ 8562us) server_negotiation.cc:407] Connection header received
0809 06:58:06.014748 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.014754 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.014837 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.014907 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:06.015823 (+ 916us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38616: BlockingRecv error: recv got EOF from 127.0.0.1:38616 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:58:06.073714 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.053713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50910 (local address 127.10.205.125:43719)
0809 06:58:06.053908 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.053914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.065439 (+ 11525us) server_negotiation.cc:407] Connection header received
0809 06:58:06.065867 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.065874 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.066113 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.066305 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.067076 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.068287 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.070451 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.071183 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.071294 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.072066 (+ 772us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.072851 (+ 785us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.072973 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.073237 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.073345 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 06:58:06.117022 2856 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:06.107501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38618 (local address 127.10.205.124:42303)
0809 06:58:06.107723 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.107729 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.114693 (+ 6964us) server_negotiation.cc:407] Connection header received
0809 06:58:06.115284 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.115292 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.115455 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.115538 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:06.116739 (+ 1201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38618: BlockingRecv error: recv got EOF from 127.0.0.1:38618 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:58:06.169591 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.149766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50924 (local address 127.10.205.125:43719)
0809 06:58:06.149968 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.149975 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.162152 (+ 12177us) server_negotiation.cc:407] Connection header received
0809 06:58:06.162772 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.162779 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.162881 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.162951 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.163716 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.164985 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.167169 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.167877 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.167993 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.168697 (+ 704us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.168849 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.168918 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.169157 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.169261 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 06:58:06.213061 2856 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:06.203755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38622 (local address 127.10.205.124:42303)
0809 06:58:06.203943 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.203948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.210896 (+ 6948us) server_negotiation.cc:407] Connection header received
0809 06:58:06.211453 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.211459 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.211561 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.211639 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:06.212805 (+ 1166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38622: BlockingRecv error: recv got EOF from 127.0.0.1:38622 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 06:58:06.246516 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.238426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50932 (local address 127.10.205.125:43719)
0809 06:58:06.238621 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.238627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.239594 (+ 967us) server_negotiation.cc:407] Connection header received
0809 06:58:06.239804 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.239810 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.239925 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.240037 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.240770 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.241937 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.244044 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.244755 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.244870 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.245523 (+ 653us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.245728 (+ 205us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.245793 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.246027 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.246142 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260809 06:58:06.270577 2856 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:06.258183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38634 (local address 127.10.205.124:42303)
0809 06:58:06.258373 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.258379 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.268947 (+ 10568us) server_negotiation.cc:407] Connection header received
0809 06:58:06.269160 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.269166 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.269280 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.269416 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:06.270353 (+ 937us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38634: BlockingRecv error: recv got EOF from 127.0.0.1:38634 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 06:58:06.285439 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.278082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50936 (local address 127.10.205.125:43719)
0809 06:58:06.278342 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.278349 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.278902 (+ 553us) server_negotiation.cc:407] Connection header received
0809 06:58:06.279119 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.279125 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.279256 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.279358 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.279839 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.281015 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.283029 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.283827 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.283972 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.284569 (+ 597us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.284717 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.284827 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.285015 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.285114 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
W20260809 06:58:06.298475 2856 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:06.292132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38640 (local address 127.10.205.124:42303)
0809 06:58:06.292383 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.292389 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.296902 (+ 4513us) server_negotiation.cc:407] Connection header received
0809 06:58:06.297072 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.297077 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.297178 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.297303 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:06.298213 (+ 910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38640: BlockingRecv error: recv got EOF from 127.0.0.1:38640 (error 108)
Metrics: {"server-negotiator.queue_time_us":134}
I20260809 06:58:06.317220 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.310100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50946 (local address 127.10.205.125:43719)
0809 06:58:06.310290 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.310297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.310895 (+ 598us) server_negotiation.cc:407] Connection header received
0809 06:58:06.311078 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.311084 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.311185 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.311312 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.311847 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.313002 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.314947 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.315673 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.315821 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.316365 (+ 544us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.316519 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.316617 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.316792 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.316885 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260809 06:58:06.332203 2856 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:06.329826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38646 (local address 127.10.205.124:42303)
0809 06:58:06.330023 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.330030 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.330600 (+ 570us) server_negotiation.cc:407] Connection header received
0809 06:58:06.330797 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.330803 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.330899 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.331013 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:06.331966 (+ 953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38646: BlockingRecv error: recv got EOF from 127.0.0.1:38646 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:58:06.359510 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.351952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50952 (local address 127.10.205.125:43719)
0809 06:58:06.352133 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.352139 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.353204 (+ 1065us) server_negotiation.cc:407] Connection header received
0809 06:58:06.353408 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.353414 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.353513 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.353616 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.354110 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.355402 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.357388 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.358085 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.358245 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.358714 (+ 469us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.358844 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.358953 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.359123 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.359244 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 06:58:06.374194 2856 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:06.371793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38654 (local address 127.10.205.124:42303)
0809 06:58:06.371971 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.371976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.372592 (+ 616us) server_negotiation.cc:407] Connection header received
0809 06:58:06.372794 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.372800 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.372908 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.373024 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:06.373964 (+ 940us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38654: BlockingRecv error: recv got EOF from 127.0.0.1:38654 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:58:06.416797 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.409676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50968 (local address 127.10.205.125:43719)
0809 06:58:06.409910 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.409916 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.410498 (+ 582us) server_negotiation.cc:407] Connection header received
0809 06:58:06.410716 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.410722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.410821 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.410928 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.411456 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.412596 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.414583 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.415289 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.415411 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.415908 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.416044 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.416112 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.416375 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.416459 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 06:58:06.426244 2856 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:06.423174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38668 (local address 127.10.205.124:42303)
0809 06:58:06.423424 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.423433 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.424817 (+ 1384us) server_negotiation.cc:407] Connection header received
0809 06:58:06.424985 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.424991 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.425080 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.425193 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:06.425997 (+ 804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38668: BlockingRecv error: recv got EOF from 127.0.0.1:38668 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:58:06.499294 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.494359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50972 (local address 127.10.205.125:43719)
0809 06:58:06.494612 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.494618 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.494954 (+ 336us) server_negotiation.cc:407] Connection header received
0809 06:58:06.495123 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.495127 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.495202 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.495283 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.495675 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.496456 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.497714 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.498149 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.498247 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.498605 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.498699 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.498765 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.498900 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.498965 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 06:58:06.506714 2856 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:58:06.505010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38670 (local address 127.10.205.124:42303)
0809 06:58:06.505253 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.505267 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.505492 (+ 225us) server_negotiation.cc:407] Connection header received
0809 06:58:06.505614 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.505618 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.505687 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.505768 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:58:06.506509 (+ 741us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38670: BlockingRecv error: recv got EOF from 127.0.0.1:38670 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 06:58:06.576766 2874 catalog_manager.cc:1259] Loaded cluster ID: 8318622ff00343f1a20bc8565701174c
I20260809 06:58:06.576874 2874 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5: loading cluster ID for follower catalog manager: success
I20260809 06:58:06.579308 2874 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5: acquiring CA information for follower catalog manager: success
I20260809 06:58:06.581056 2874 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8083019ab23643fc97ffbca85c0abbb5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:58:06.649003 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.644115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50984 (local address 127.10.205.125:43719)
0809 06:58:06.644310 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.644314 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.644786 (+ 472us) server_negotiation.cc:407] Connection header received
0809 06:58:06.644931 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.644935 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.645007 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.645088 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.645469 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.646185 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.647440 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.647887 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.647983 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.648334 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.648441 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.648509 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.648640 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.648701 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:58:06.660198 2856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.654909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38672 (local address 127.10.205.124:42303)
0809 06:58:06.655089 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.655094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.655538 (+ 444us) server_negotiation.cc:407] Connection header received
0809 06:58:06.655699 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.655703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.655879 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.655976 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.656355 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.657046 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.658265 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.658673 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.658762 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.659202 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.659746 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.659861 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.659938 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.659999 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:58:06.677359 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.666316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50996 (local address 127.10.205.125:43719)
0809 06:58:06.666577 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.666586 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.670823 (+ 4237us) server_negotiation.cc:407] Connection header received
0809 06:58:06.671119 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.671126 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.671220 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.671286 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.672148 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.672910 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.674759 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.675312 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.675445 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.676591 (+ 1146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.676701 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.676800 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.676967 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.677047 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 06:58:06.677824 2856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.666606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38680 (local address 127.10.205.124:42303)
0809 06:58:06.666838 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.666846 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.671139 (+ 4293us) server_negotiation.cc:407] Connection header received
0809 06:58:06.671415 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.671420 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.671520 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.671605 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.672371 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.673398 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.675455 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.675857 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.675987 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.676901 (+ 914us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.677016 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.677098 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.677450 (+ 352us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.677545 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 06:58:06.677983 3033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:58:06.666792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55482 (local address 127.10.205.126:33501)
0809 06:58:06.670389 (+ 3597us) server_negotiation.cc:206] Beginning negotiation
0809 06:58:06.670397 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:58:06.670421 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:58:06.670557 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:58:06.670565 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:58:06.670820 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:58:06.671036 (+ 216us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:58:06.671612 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.672808 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.675071 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:58:06.675648 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:58:06.675774 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:58:06.676305 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:58:06.676742 (+ 437us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:58:06.676867 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 06:58:06.677608 (+ 741us) server_negotiation.cc:299] Negotiation successful
0809 06:58:06.677686 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3432,"thread_start_us":3291,"threads_started":1}
I20260809 06:58:06.682567 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 2633
I20260809 06:58:06.683526 2696 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:58:06.793857 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 2633
W20260809 06:58:06.817660 2729 connection.cc:535] server connection from 127.0.0.1:50866 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 06:58:06.817656 2803 connection.cc:535] server connection from 127.0.0.1:38588 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 06:58:06.818279 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 2708
I20260809 06:58:06.819274 2773 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:58:06.925026 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 2708
I20260809 06:58:06.947585 11061 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu pid 2786
I20260809 06:58:06.948695 2848 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:58:07.056835 11061 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskDfk6Nc/build/asan/bin/kudu with pid 2786
2026-08-09T06:58:07Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4601 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9665 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (375857 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST